2023/04/04 11:30:08 479206 |  TRACE   |  Model configs:
2023/04/04 11:30:08 479573 |  TRACE   |  - Model: 20230404T113006-Unet+Eff-b0+ws10+ts36+rgb
2023/04/04 11:30:08 479732 |  TRACE   |  - Parameters: 6_292_077
2023/04/04 11:30:08 479884 |  TRACE   |  - Device: cuda
2023/04/04 11:30:08 480045 |  TRACE   |  - Input bands: ['s2_ndvi', 's2_b02', 's2_b03', 's2_b04']
2023/04/04 11:30:08 480206 |  TRACE   |  - N ts: 36
 
2023/04/04 11:30:08 480375 |  TRACE   |  Steps configs:
2023/04/04 11:30:08 480549 |  TRACE   |  - Maximum steps: None
2023/04/04 11:30:08 480712 |  TRACE   |  - Validation steps: 250
2023/04/04 11:30:08 480872 |  TRACE   |  - Batch-size: 32
 
2023/04/04 11:30:08 481031 |  TRACE   |  Optimizer configs:
2023/04/04 11:30:08 481219 |  TRACE   |  - Optimizer: Adam
2023/04/04 11:30:08 481388 |  TRACE   |  - Early-stopping tolerance: 10
2023/04/04 11:30:08 481573 |  TRACE   |  - Early-stopping improvement: 0.0001
2023/04/04 11:30:08 481716 |  TRACE   |  - Early-stopping metric: loss
2023/04/04 11:30:08 481851 |  TRACE   |  - Scheduler: ReduceLROnPlateau
2023/04/04 11:30:08 481980 |  TRACE   |  - Learninr rate tolerance: 3
 
2023/04/04 11:30:08 482110 |  TRACE   |  Loss configs:
2023/04/04 11:30:08 482316 |  TRACE   |  - Tag: DiceLoss
2023/04/04 11:30:08 482481 |  TRACE   |  - Loss: dice_loss
2023/04/04 11:30:08 482646 |  TRACE   |  - Weight / multiplier: None
2023/04/04 11:30:08 482779 |  TRACE   |  - LC coefficient: 0
2023/04/04 11:30:08 482912 |  TRACE   |  ---
2023/04/04 11:30:08 483039 |  TRACE   |  - Tag: DiceLoss_ws
2023/04/04 11:30:08 483220 |  TRACE   |  - Loss: dice_loss
2023/04/04 11:30:08 483366 |  TRACE   |  - Weight / multiplier: {'watersheds': 10}
2023/04/04 11:30:08 483522 |  TRACE   |  - LC coefficient: 1
2023/04/04 11:30:08 483683 |  TRACE   |  ---
2023/04/04 11:30:08 483862 |  TRACE   |  - Tag: DiceLoss_d
2023/04/04 11:30:08 484018 |  TRACE   |  - Loss: dice_loss
2023/04/04 11:30:08 484181 |  TRACE   |  - Weight / multiplier: {'distance': 1}
2023/04/04 11:30:08 484360 |  TRACE   |  - LC coefficient: 0
2023/04/04 11:30:08 484523 |  TRACE   | 

2023/04/04 11:30:26 970301 |  TRACE   | Writing results to TensorBoard:
2023/04/04 11:30:26 970859 |  TRACE   |  - Start loss computation
2023/04/04 11:30:26 971407 |  TRACE   |  - Start image generation for 100 images
2023/04/04 11:30:33 158487 |  TRACE   | 

2023/04/04 11:30:33 159008 |  TRACE   | Training for 250 steps (current step: 0)
2023/04/04 11:39:45 644789 |  TRACE   | Validating
2023/04/04 11:40:24 146139 |  TRACE   | Writing results to TensorBoard:
2023/04/04 11:40:24 146741 |  TRACE   |  - Start loss computation
2023/04/04 11:40:24 147262 |  TRACE   |  - Start image generation for 100 images
2023/04/04 11:41:22 448648 |  TRACE   |  - New best loss: 0.35613
2023/04/04 11:41:22 449236 |  TRACE   |  - Improvement over previous best: -0.33066
2023/04/04 11:41:22 596552 |  TRACE   |  - Best model updated!
 
2023/04/04 11:41:22 596958 |  TRACE   | Training for 250 steps (current step: 250)
2023/04/04 11:46:45 810757 |  TRACE   | Validating
2023/04/04 11:47:00 158216 |  TRACE   | Writing results to TensorBoard:
2023/04/04 11:47:00 158837 |  TRACE   |  - Start loss computation
2023/04/04 11:47:00 159515 |  TRACE   |  - Start image generation for 100 images
2023/04/04 11:48:21 703686 |  TRACE   |  - New best loss: 0.30142
2023/04/04 11:48:21 704217 |  TRACE   |  - Improvement over previous best: -0.05471
2023/04/04 11:48:21 989316 |  TRACE   |  - Best model updated!
 
2023/04/04 11:48:21 989726 |  TRACE   | Training for 250 steps (current step: 500)
2023/04/04 11:53:53 647340 |  TRACE   | Validating
2023/04/04 11:54:06 687768 |  TRACE   | Writing results to TensorBoard:
2023/04/04 11:54:06 688309 |  TRACE   |  - Start loss computation
2023/04/04 11:54:06 688952 |  TRACE   |  - Start image generation for 100 images
2023/04/04 11:55:25 692938 |  TRACE   |  - No improvement for loss: 0.31232 (current best: 0.30142)
2023/04/04 11:55:25 693416 |  TRACE   | Training for 250 steps (current step: 750)
2023/04/04 12:00:15 064762 |  TRACE   | Validating
2023/04/04 12:00:28 026195 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:00:28 026782 |  TRACE   |  - Start loss computation
2023/04/04 12:00:28 027284 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:01:51 408787 |  TRACE   |  - New best loss: 0.28668
2023/04/04 12:01:51 409430 |  TRACE   |  - Improvement over previous best: -0.01475
2023/04/04 12:01:51 564084 |  TRACE   |  - Best model updated!
 
2023/04/04 12:01:51 564466 |  TRACE   | Training for 250 steps (current step: 1000)
2023/04/04 12:07:22 136195 |  TRACE   | Validating
2023/04/04 12:07:35 258085 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:07:35 258524 |  TRACE   |  - Start loss computation
2023/04/04 12:07:35 259247 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:09:01 289357 |  TRACE   |  - No improvement for loss: 0.29595 (current best: 0.28668)
2023/04/04 12:09:01 289856 |  TRACE   | Training for 250 steps (current step: 1250)
2023/04/04 12:14:03 157611 |  TRACE   | Validating
2023/04/04 12:14:16 237037 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:14:16 237620 |  TRACE   |  - Start loss computation
2023/04/04 12:14:16 238110 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:15:44 719103 |  TRACE   |  - New best loss: 0.28162
2023/04/04 12:15:44 719659 |  TRACE   |  - Improvement over previous best: -0.00506
2023/04/04 12:15:44 863529 |  TRACE   |  - Best model updated!
 
2023/04/04 12:15:44 863887 |  TRACE   | Training for 250 steps (current step: 1500)
2023/04/04 12:21:12 028224 |  TRACE   | Validating
2023/04/04 12:21:25 091600 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:21:25 092160 |  TRACE   |  - Start loss computation
2023/04/04 12:21:25 092597 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:22:59 939609 |  TRACE   |  - No improvement for loss: 0.28680 (current best: 0.28162)
2023/04/04 12:22:59 940067 |  TRACE   | Training for 250 steps (current step: 1750)
2023/04/04 12:28:03 417240 |  TRACE   | Validating
2023/04/04 12:28:16 920689 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:28:16 921157 |  TRACE   |  - Start loss computation
2023/04/04 12:28:16 921780 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:29:36 831398 |  TRACE   |  - No improvement for loss: 0.29715 (current best: 0.28162)
2023/04/04 12:29:36 831919 |  TRACE   | Training for 250 steps (current step: 2000)
2023/04/04 12:35:20 281814 |  TRACE   | Validating
2023/04/04 12:35:33 660871 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:35:33 661376 |  TRACE   |  - Start loss computation
2023/04/04 12:35:33 661811 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:36:54 863926 |  TRACE   |  - New best loss: 0.27393
2023/04/04 12:36:54 864572 |  TRACE   |  - Improvement over previous best: -0.00768
2023/04/04 12:36:55 006977 |  TRACE   |  - Best model updated!
 
2023/04/04 12:36:55 007363 |  TRACE   | Training for 250 steps (current step: 2250)
2023/04/04 12:41:40 768869 |  TRACE   | Validating
2023/04/04 12:41:54 695517 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:41:54 696170 |  TRACE   |  - Start loss computation
2023/04/04 12:41:54 696660 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:43:28 241726 |  TRACE   |  - No improvement for loss: 0.27604 (current best: 0.27393)
2023/04/04 12:43:28 242239 |  TRACE   | Training for 250 steps (current step: 2500)
2023/04/04 12:49:00 327865 |  TRACE   | Validating
2023/04/04 12:49:13 700708 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:49:13 701269 |  TRACE   |  - Start loss computation
2023/04/04 12:49:13 701907 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:50:34 728865 |  TRACE   |  - New best loss: 0.26655
2023/04/04 12:50:34 729528 |  TRACE   |  - Improvement over previous best: -0.00738
2023/04/04 12:50:35 035510 |  TRACE   |  - Best model updated!
 
2023/04/04 12:50:35 035989 |  TRACE   | Training for 250 steps (current step: 2750)
2023/04/04 12:55:32 282043 |  TRACE   | Validating
2023/04/04 12:55:45 539598 |  TRACE   | Writing results to TensorBoard:
2023/04/04 12:55:45 540185 |  TRACE   |  - Start loss computation
2023/04/04 12:55:45 540647 |  TRACE   |  - Start image generation for 100 images
2023/04/04 12:57:14 276502 |  TRACE   |  - New best loss: 0.24797
2023/04/04 12:57:14 277146 |  TRACE   |  - Improvement over previous best: -0.01858
2023/04/04 12:57:14 423673 |  TRACE   |  - Best model updated!
 
2023/04/04 12:57:14 424102 |  TRACE   | Training for 250 steps (current step: 3000)
2023/04/04 13:02:48 387889 |  TRACE   | Validating
2023/04/04 13:03:01 507639 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:03:01 508176 |  TRACE   |  - Start loss computation
2023/04/04 13:03:01 508671 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:04:21 651387 |  TRACE   |  - No improvement for loss: 0.29977 (current best: 0.24797)
2023/04/04 13:04:21 651905 |  TRACE   | Training for 250 steps (current step: 3250)
2023/04/04 13:09:22 893338 |  TRACE   | Validating
2023/04/04 13:09:36 144778 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:09:36 145280 |  TRACE   |  - Start loss computation
2023/04/04 13:09:36 145710 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:11:08 903029 |  TRACE   |  - No improvement for loss: 0.25298 (current best: 0.24797)
2023/04/04 13:11:08 903514 |  TRACE   | Training for 250 steps (current step: 3500)
2023/04/04 13:16:43 518598 |  TRACE   | Validating
2023/04/04 13:16:56 970114 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:16:56 970701 |  TRACE   |  - Start loss computation
2023/04/04 13:16:56 971211 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:18:26 302750 |  TRACE   |  - No improvement for loss: 0.25619 (current best: 0.24797)
2023/04/04 13:18:26 303274 |  TRACE   | Training for 250 steps (current step: 3750)
2023/04/04 13:23:24 643962 |  TRACE   | Validating
2023/04/04 13:23:38 061611 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:23:38 062145 |  TRACE   |  - Start loss computation
2023/04/04 13:23:38 062754 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:25:11 004872 |  TRACE   |  - No improvement for loss: 0.25126 (current best: 0.24797)
2023/04/04 13:25:11 005415 |  TRACE   | Training for 250 steps (current step: 4000)
2023/04/04 13:30:57 357688 |  TRACE   | Validating
2023/04/04 13:31:10 569810 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:31:10 570373 |  TRACE   |  - Start loss computation
2023/04/04 13:31:10 570828 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:32:41 081475 |  TRACE   |  - New best loss: 0.22715
2023/04/04 13:32:41 082251 |  TRACE   |  - Improvement over previous best: -0.02083
2023/04/04 13:32:41 235199 |  TRACE   |  - Best model updated!
 
2023/04/04 13:32:41 235688 |  TRACE   | Training for 250 steps (current step: 4250)
2023/04/04 13:37:42 055955 |  TRACE   | Validating
2023/04/04 13:37:55 069687 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:37:55 070248 |  TRACE   |  - Start loss computation
2023/04/04 13:37:55 070673 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:39:25 047085 |  TRACE   |  - New best loss: 0.22635
2023/04/04 13:39:25 047683 |  TRACE   |  - Improvement over previous best: -0.00080
2023/04/04 13:39:25 198806 |  TRACE   |  - Best model updated!
 
2023/04/04 13:39:25 199242 |  TRACE   | Training for 250 steps (current step: 4500)
2023/04/04 13:45:07 480349 |  TRACE   | Validating
2023/04/04 13:45:20 782600 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:45:20 783142 |  TRACE   |  - Start loss computation
2023/04/04 13:45:20 783627 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:46:52 289282 |  TRACE   |  - New best loss: 0.22586
2023/04/04 13:46:52 289872 |  TRACE   |  - Improvement over previous best: -0.00048
2023/04/04 13:46:52 437097 |  TRACE   |  - Best model updated!
 
2023/04/04 13:46:52 437535 |  TRACE   | Training for 250 steps (current step: 4750)
2023/04/04 13:51:56 221592 |  TRACE   | Validating
2023/04/04 13:52:09 503434 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:52:09 503963 |  TRACE   |  - Start loss computation
2023/04/04 13:52:09 504482 |  TRACE   |  - Start image generation for 100 images
2023/04/04 13:53:43 972806 |  TRACE   |  - No improvement for loss: 0.22599 (current best: 0.22586)
2023/04/04 13:53:43 973324 |  TRACE   | Training for 250 steps (current step: 5000)
2023/04/04 13:59:16 964342 |  TRACE   | Validating
2023/04/04 13:59:30 079673 |  TRACE   | Writing results to TensorBoard:
2023/04/04 13:59:30 080211 |  TRACE   |  - Start loss computation
2023/04/04 13:59:30 080716 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:01:02 185046 |  TRACE   |  - New best loss: 0.22483
2023/04/04 14:01:02 185627 |  TRACE   |  - Improvement over previous best: -0.00104
2023/04/04 14:01:02 339610 |  TRACE   |  - Best model updated!
 
2023/04/04 14:01:02 340038 |  TRACE   | Training for 250 steps (current step: 5250)
2023/04/04 14:06:05 568294 |  TRACE   | Validating
2023/04/04 14:06:18 771431 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:06:18 772016 |  TRACE   |  - Start loss computation
2023/04/04 14:06:18 772523 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:07:48 776670 |  TRACE   |  - No improvement for loss: 0.22569 (current best: 0.22483)
2023/04/04 14:07:48 777169 |  TRACE   | Training for 250 steps (current step: 5500)
2023/04/04 14:13:23 130412 |  TRACE   | Validating
2023/04/04 14:13:36 395623 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:13:36 396135 |  TRACE   |  - Start loss computation
2023/04/04 14:13:36 396584 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:15:08 335328 |  TRACE   |  - No improvement for loss: 0.22585 (current best: 0.22483)
2023/04/04 14:15:08 335813 |  TRACE   | Training for 250 steps (current step: 5750)
2023/04/04 14:19:56 504781 |  TRACE   | Validating
2023/04/04 14:20:09 610328 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:20:09 610920 |  TRACE   |  - Start loss computation
2023/04/04 14:20:09 611459 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:21:45 758131 |  TRACE   |  - No improvement for loss: 0.22476 (current best: 0.22483)
2023/04/04 14:21:45 758710 |  TRACE   | Training for 250 steps (current step: 6000)
2023/04/04 14:27:32 413272 |  TRACE   | Validating
2023/04/04 14:27:45 537849 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:27:45 538379 |  TRACE   |  - Start loss computation
2023/04/04 14:27:45 538985 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:29:17 390430 |  TRACE   |  - No improvement for loss: 0.22651 (current best: 0.22483)
2023/04/04 14:29:17 390920 |  TRACE   | Training for 250 steps (current step: 6250)
2023/04/04 14:34:14 194501 |  TRACE   | Validating
2023/04/04 14:34:27 340905 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:34:27 341396 |  TRACE   |  - Start loss computation
2023/04/04 14:34:27 341926 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:36:03 377130 |  TRACE   |  - No improvement for loss: 0.22647 (current best: 0.22483)
2023/04/04 14:36:03 377672 |  TRACE   | Training for 250 steps (current step: 6500)
2023/04/04 14:41:30 711518 |  TRACE   | Validating
2023/04/04 14:41:44 068509 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:41:44 069143 |  TRACE   |  - Start loss computation
2023/04/04 14:41:44 069733 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:43:21 306491 |  TRACE   |  - New best loss: 0.22440
2023/04/04 14:43:21 307042 |  TRACE   |  - Improvement over previous best: -0.00043
2023/04/04 14:43:21 450569 |  TRACE   |  - Best model updated!
 
2023/04/04 14:43:21 450954 |  TRACE   | Training for 250 steps (current step: 6750)
2023/04/04 14:48:28 416718 |  TRACE   | Validating
2023/04/04 14:48:41 519101 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:48:41 519555 |  TRACE   |  - Start loss computation
2023/04/04 14:48:41 520148 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:50:13 129194 |  TRACE   |  - New best loss: 0.22410
2023/04/04 14:50:13 129807 |  TRACE   |  - Improvement over previous best: -0.00030
2023/04/04 14:50:13 279187 |  TRACE   |  - Best model updated!
 
2023/04/04 14:50:13 279617 |  TRACE   | Training for 250 steps (current step: 7000)
2023/04/04 14:55:52 912534 |  TRACE   | Validating
2023/04/04 14:56:05 788671 |  TRACE   | Writing results to TensorBoard:
2023/04/04 14:56:05 789212 |  TRACE   |  - Start loss computation
2023/04/04 14:56:05 789637 |  TRACE   |  - Start image generation for 100 images
2023/04/04 14:57:35 985646 |  TRACE   |  - New best loss: 0.22360
2023/04/04 14:57:35 986278 |  TRACE   |  - Improvement over previous best: -0.00050
2023/04/04 14:57:36 135506 |  TRACE   |  - Best model updated!
 
2023/04/04 14:57:36 135884 |  TRACE   | Training for 250 steps (current step: 7250)
2023/04/04 15:02:42 234070 |  TRACE   | Validating
2023/04/04 15:02:55 289938 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:02:55 290455 |  TRACE   |  - Start loss computation
2023/04/04 15:02:55 290906 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:04:30 882398 |  TRACE   |  - No improvement for loss: 0.22365 (current best: 0.22360)
2023/04/04 15:04:30 883019 |  TRACE   | Training for 250 steps (current step: 7500)
2023/04/04 15:10:09 084465 |  TRACE   | Validating
2023/04/04 15:10:22 160788 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:10:22 161347 |  TRACE   |  - Start loss computation
2023/04/04 15:10:22 161895 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:11:57 642622 |  TRACE   |  - New best loss: 0.22330
2023/04/04 15:11:57 643202 |  TRACE   |  - Improvement over previous best: -0.00030
2023/04/04 15:11:57 798044 |  TRACE   |  - Best model updated!
 
2023/04/04 15:11:57 798540 |  TRACE   | Training for 250 steps (current step: 7750)
2023/04/04 15:17:02 832141 |  TRACE   | Validating
2023/04/04 15:17:16 297329 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:17:16 297925 |  TRACE   |  - Start loss computation
2023/04/04 15:17:16 298468 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:18:47 781918 |  TRACE   |  - No improvement for loss: 0.22529 (current best: 0.22330)
2023/04/04 15:18:47 782456 |  TRACE   | Training for 250 steps (current step: 8000)
2023/04/04 15:24:14 076299 |  TRACE   | Validating
2023/04/04 15:24:27 048331 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:24:27 048794 |  TRACE   |  - Start loss computation
2023/04/04 15:24:27 049365 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:25:57 920126 |  TRACE   |  - No improvement for loss: 0.22351 (current best: 0.22330)
2023/04/04 15:25:57 920583 |  TRACE   | Training for 250 steps (current step: 8250)
2023/04/04 15:31:06 178047 |  TRACE   | Validating
2023/04/04 15:31:19 007579 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:31:19 008163 |  TRACE   |  - Start loss computation
2023/04/04 15:31:19 008767 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:32:50 721180 |  TRACE   |  - No improvement for loss: 0.22366 (current best: 0.22330)
2023/04/04 15:32:50 721667 |  TRACE   | Training for 250 steps (current step: 8500)
2023/04/04 15:38:22 675492 |  TRACE   | Validating
2023/04/04 15:38:35 576885 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:38:35 577401 |  TRACE   |  - Start loss computation
2023/04/04 15:38:35 577831 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:40:09 140093 |  TRACE   |  - New best loss: 0.22292
2023/04/04 15:40:09 140687 |  TRACE   |  - Improvement over previous best: -0.00038
2023/04/04 15:40:09 289995 |  TRACE   |  - Best model updated!
 
2023/04/04 15:40:09 290522 |  TRACE   | Training for 250 steps (current step: 8750)
2023/04/04 15:44:58 365020 |  TRACE   | Validating
2023/04/04 15:45:11 228069 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:45:11 228568 |  TRACE   |  - Start loss computation
2023/04/04 15:45:11 228996 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:46:40 520622 |  TRACE   |  - New best loss: 0.22273
2023/04/04 15:46:40 521192 |  TRACE   |  - Improvement over previous best: -0.00019
2023/04/04 15:46:40 669503 |  TRACE   |  - Best model updated!
 
2023/04/04 15:46:40 669927 |  TRACE   | Training for 250 steps (current step: 9000)
2023/04/04 15:52:05 405362 |  TRACE   | Validating
2023/04/04 15:52:18 126806 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:52:18 127285 |  TRACE   |  - Start loss computation
2023/04/04 15:52:18 127702 |  TRACE   |  - Start image generation for 100 images
2023/04/04 15:53:48 655791 |  TRACE   |  - New best loss: 0.22251
2023/04/04 15:53:48 656373 |  TRACE   |  - Improvement over previous best: -0.00022
2023/04/04 15:53:48 946660 |  TRACE   |  - Best model updated!
 
2023/04/04 15:53:48 947091 |  TRACE   | Training for 250 steps (current step: 9250)
2023/04/04 15:58:48 105395 |  TRACE   | Validating
2023/04/04 15:59:01 153337 |  TRACE   | Writing results to TensorBoard:
2023/04/04 15:59:01 153881 |  TRACE   |  - Start loss computation
2023/04/04 15:59:01 154392 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:00:37 123736 |  TRACE   |  - New best loss: 0.22229
2023/04/04 16:00:37 124333 |  TRACE   |  - Improvement over previous best: -0.00022
2023/04/04 16:00:37 267996 |  TRACE   |  - Best model updated!
 
2023/04/04 16:00:37 268430 |  TRACE   | Training for 250 steps (current step: 9500)
2023/04/04 16:06:17 412453 |  TRACE   | Validating
2023/04/04 16:06:30 524432 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:06:30 524992 |  TRACE   |  - Start loss computation
2023/04/04 16:06:30 525429 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:08:08 825217 |  TRACE   |  - New best loss: 0.22214
2023/04/04 16:08:08 825771 |  TRACE   |  - Improvement over previous best: -0.00015
2023/04/04 16:08:08 968222 |  TRACE   |  - Best model updated!
 
2023/04/04 16:08:08 968640 |  TRACE   | Training for 250 steps (current step: 9750)
2023/04/04 16:13:10 798301 |  TRACE   | Validating
2023/04/04 16:13:23 593521 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:13:23 594033 |  TRACE   |  - Start loss computation
2023/04/04 16:13:23 594474 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:14:55 629093 |  TRACE   |  - No improvement for loss: 0.22320 (current best: 0.22214)
2023/04/04 16:14:55 629553 |  TRACE   | Training for 250 steps (current step: 10000)
2023/04/04 16:20:27 259245 |  TRACE   | Validating
2023/04/04 16:20:40 211305 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:20:40 211791 |  TRACE   |  - Start loss computation
2023/04/04 16:20:40 212235 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:22:10 948391 |  TRACE   |  - No improvement for loss: 0.22211 (current best: 0.22214)
2023/04/04 16:22:10 948878 |  TRACE   | Training for 250 steps (current step: 10250)
2023/04/04 16:27:19 911032 |  TRACE   | Validating
2023/04/04 16:27:32 786894 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:27:32 787421 |  TRACE   |  - Start loss computation
2023/04/04 16:27:32 787839 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:29:08 592668 |  TRACE   |  - No improvement for loss: 0.22359 (current best: 0.22214)
2023/04/04 16:29:08 593158 |  TRACE   | Training for 250 steps (current step: 10500)
2023/04/04 16:34:49 917118 |  TRACE   | Validating
2023/04/04 16:35:02 668888 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:35:02 669388 |  TRACE   |  - Start loss computation
2023/04/04 16:35:02 669902 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:36:36 602215 |  TRACE   |  - New best loss: 0.22150
2023/04/04 16:36:36 602885 |  TRACE   |  - Improvement over previous best: -0.00064
2023/04/04 16:36:36 760381 |  TRACE   |  - Best model updated!
 
2023/04/04 16:36:36 760792 |  TRACE   | Training for 250 steps (current step: 10750)
2023/04/04 16:41:42 973056 |  TRACE   | Validating
2023/04/04 16:41:55 834120 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:41:55 834636 |  TRACE   |  - Start loss computation
2023/04/04 16:41:55 835052 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:43:28 268876 |  TRACE   |  - No improvement for loss: 0.22325 (current best: 0.22150)
2023/04/04 16:43:28 269337 |  TRACE   | Training for 250 steps (current step: 11000)
2023/04/04 16:49:01 756109 |  TRACE   | Validating
2023/04/04 16:49:14 520070 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:49:14 520609 |  TRACE   |  - Start loss computation
2023/04/04 16:49:14 521028 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:50:51 017037 |  TRACE   |  - No improvement for loss: 0.22165 (current best: 0.22150)
2023/04/04 16:50:51 017487 |  TRACE   | Training for 250 steps (current step: 11250)
2023/04/04 16:55:40 710003 |  TRACE   | Validating
2023/04/04 16:55:53 475448 |  TRACE   | Writing results to TensorBoard:
2023/04/04 16:55:53 475949 |  TRACE   |  - Start loss computation
2023/04/04 16:55:53 476430 |  TRACE   |  - Start image generation for 100 images
2023/04/04 16:57:25 562666 |  TRACE   |  - New best loss: 0.22068
2023/04/04 16:57:25 563287 |  TRACE   |  - Improvement over previous best: -0.00082
2023/04/04 16:57:25 701441 |  TRACE   |  - Best model updated!
 
2023/04/04 16:57:25 701874 |  TRACE   | Training for 250 steps (current step: 11500)
2023/04/04 17:02:53 736393 |  TRACE   | Validating
2023/04/04 17:03:06 783658 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:03:06 784217 |  TRACE   |  - Start loss computation
2023/04/04 17:03:06 784684 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:04:40 961757 |  TRACE   |  - No improvement for loss: 0.22111 (current best: 0.22068)
2023/04/04 17:04:40 962295 |  TRACE   | Training for 250 steps (current step: 11750)
2023/04/04 17:09:24 226837 |  TRACE   | Validating
2023/04/04 17:09:37 003131 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:09:37 003681 |  TRACE   |  - Start loss computation
2023/04/04 17:09:37 004104 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:11:12 055177 |  TRACE   |  - New best loss: 0.22055
2023/04/04 17:11:12 055718 |  TRACE   |  - Improvement over previous best: -0.00013
2023/04/04 17:11:12 191127 |  TRACE   |  - Best model updated!
 
2023/04/04 17:11:12 191503 |  TRACE   | Training for 250 steps (current step: 12000)
2023/04/04 17:16:38 837301 |  TRACE   | Validating
2023/04/04 17:16:51 668997 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:16:51 669517 |  TRACE   |  - Start loss computation
2023/04/04 17:16:51 669962 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:18:31 057546 |  TRACE   |  - No improvement for loss: 0.22321 (current best: 0.22055)
2023/04/04 17:18:31 058021 |  TRACE   | Training for 250 steps (current step: 12250)
2023/04/04 17:23:18 490586 |  TRACE   | Validating
2023/04/04 17:23:31 185478 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:23:31 185944 |  TRACE   |  - Start loss computation
2023/04/04 17:23:31 186459 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:25:05 357189 |  TRACE   |  - New best loss: 0.22034
2023/04/04 17:25:05 357708 |  TRACE   |  - Improvement over previous best: -0.00021
2023/04/04 17:25:05 496425 |  TRACE   |  - Best model updated!
 
2023/04/04 17:25:05 496810 |  TRACE   | Training for 250 steps (current step: 12500)
2023/04/04 17:30:32 985226 |  TRACE   | Validating
2023/04/04 17:30:45 632549 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:30:45 633042 |  TRACE   |  - Start loss computation
2023/04/04 17:30:45 633466 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:32:18 567044 |  TRACE   |  - No improvement for loss: 0.22088 (current best: 0.22034)
2023/04/04 17:32:18 567522 |  TRACE   | Training for 250 steps (current step: 12750)
2023/04/04 17:37:07 836731 |  TRACE   | Validating
2023/04/04 17:37:20 621988 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:37:20 622522 |  TRACE   |  - Start loss computation
2023/04/04 17:37:20 622952 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:38:54 522571 |  TRACE   |  - New best loss: 0.21915
2023/04/04 17:38:54 523133 |  TRACE   |  - Improvement over previous best: -0.00118
2023/04/04 17:38:54 672256 |  TRACE   |  - Best model updated!
 
2023/04/04 17:38:54 672654 |  TRACE   | Training for 250 steps (current step: 13000)
2023/04/04 17:44:43 481785 |  TRACE   | Validating
2023/04/04 17:44:56 566863 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:44:56 567423 |  TRACE   |  - Start loss computation
2023/04/04 17:44:56 567860 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:46:32 464731 |  TRACE   |  - No improvement for loss: 0.21994 (current best: 0.21915)
2023/04/04 17:46:32 465243 |  TRACE   | Training for 250 steps (current step: 13250)
2023/04/04 17:51:20 319298 |  TRACE   | Validating
2023/04/04 17:51:33 169062 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:51:33 169614 |  TRACE   |  - Start loss computation
2023/04/04 17:51:33 170057 |  TRACE   |  - Start image generation for 100 images
2023/04/04 17:53:11 629036 |  TRACE   |  - No improvement for loss: 0.22003 (current best: 0.21915)
2023/04/04 17:53:11 629506 |  TRACE   | Training for 250 steps (current step: 13500)
2023/04/04 17:58:48 145643 |  TRACE   | Validating
2023/04/04 17:59:01 003669 |  TRACE   | Writing results to TensorBoard:
2023/04/04 17:59:01 004219 |  TRACE   |  - Start loss computation
2023/04/04 17:59:01 004657 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:00:34 699920 |  TRACE   |  - No improvement for loss: 0.22318 (current best: 0.21915)
2023/04/04 18:00:34 700426 |  TRACE   | Training for 250 steps (current step: 13750)
2023/04/04 18:05:39 322256 |  TRACE   | Validating
2023/04/04 18:05:52 159588 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:05:52 160139 |  TRACE   |  - Start loss computation
2023/04/04 18:05:52 160622 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:07:28 186108 |  TRACE   |  - No improvement for loss: 0.21917 (current best: 0.21915)
2023/04/04 18:07:28 186592 |  TRACE   | Training for 250 steps (current step: 14000)
2023/04/04 18:12:49 217924 |  TRACE   | Validating
2023/04/04 18:13:02 340106 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:13:02 340663 |  TRACE   |  - Start loss computation
2023/04/04 18:13:02 341127 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:14:37 884858 |  TRACE   |  - New best loss: 0.21874
2023/04/04 18:14:37 885485 |  TRACE   |  - Improvement over previous best: -0.00041
2023/04/04 18:14:38 027482 |  TRACE   |  - Best model updated!
 
2023/04/04 18:14:38 027870 |  TRACE   | Training for 250 steps (current step: 14250)
2023/04/04 18:19:42 540094 |  TRACE   | Validating
2023/04/04 18:19:55 325459 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:19:55 326001 |  TRACE   |  - Start loss computation
2023/04/04 18:19:55 326469 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:21:30 702444 |  TRACE   |  - No improvement for loss: 0.21882 (current best: 0.21874)
2023/04/04 18:21:30 702921 |  TRACE   | Training for 250 steps (current step: 14500)
2023/04/04 18:26:58 961940 |  TRACE   | Validating
2023/04/04 18:27:11 677466 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:27:11 677981 |  TRACE   |  - Start loss computation
2023/04/04 18:27:11 678445 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:28:43 567179 |  TRACE   |  - New best loss: 0.21851
2023/04/04 18:28:43 567715 |  TRACE   |  - Improvement over previous best: -0.00023
2023/04/04 18:28:43 847464 |  TRACE   |  - Best model updated!
 
2023/04/04 18:28:43 847877 |  TRACE   | Training for 250 steps (current step: 14750)
2023/04/04 18:33:20 946533 |  TRACE   | Validating
2023/04/04 18:33:33 480299 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:33:33 480791 |  TRACE   |  - Start loss computation
2023/04/04 18:33:33 481206 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:35:06 711024 |  TRACE   |  - No improvement for loss: 0.21858 (current best: 0.21851)
2023/04/04 18:35:06 711457 |  TRACE   | Training for 250 steps (current step: 15000)
2023/04/04 18:40:25 259367 |  TRACE   | Validating
2023/04/04 18:40:38 020912 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:40:38 021404 |  TRACE   |  - Start loss computation
2023/04/04 18:40:38 021818 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:42:12 436519 |  TRACE   |  - No improvement for loss: 0.21857 (current best: 0.21851)
2023/04/04 18:42:12 436986 |  TRACE   | Training for 250 steps (current step: 15250)
2023/04/04 18:47:07 294837 |  TRACE   | Validating
2023/04/04 18:47:20 305205 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:47:20 305682 |  TRACE   |  - Start loss computation
2023/04/04 18:47:20 306119 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:48:56 334886 |  TRACE   |  - No improvement for loss: 0.21842 (current best: 0.21851)
2023/04/04 18:48:56 335400 |  TRACE   | Training for 250 steps (current step: 15500)
2023/04/04 18:54:19 150065 |  TRACE   | Validating
2023/04/04 18:54:31 789441 |  TRACE   | Writing results to TensorBoard:
2023/04/04 18:54:31 790003 |  TRACE   |  - Start loss computation
2023/04/04 18:54:31 790454 |  TRACE   |  - Start image generation for 100 images
2023/04/04 18:56:02 665032 |  TRACE   |  - No improvement for loss: 0.21851 (current best: 0.21851)
2023/04/04 18:56:02 665524 |  TRACE   | Training for 250 steps (current step: 15750)
2023/04/04 19:00:54 206283 |  TRACE   | Validating
2023/04/04 19:01:07 391220 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:01:07 391760 |  TRACE   |  - Start loss computation
2023/04/04 19:01:07 392227 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:02:43 868519 |  TRACE   |  - No improvement for loss: 0.21863 (current best: 0.21851)
2023/04/04 19:02:43 869100 |  TRACE   | Training for 250 steps (current step: 16000)
2023/04/04 19:08:24 207680 |  TRACE   | Validating
2023/04/04 19:08:37 435390 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:08:37 435913 |  TRACE   |  - Start loss computation
2023/04/04 19:08:37 436396 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:10:12 303376 |  TRACE   |  - No improvement for loss: 0.21842 (current best: 0.21851)
2023/04/04 19:10:12 303850 |  TRACE   | Training for 250 steps (current step: 16250)
2023/04/04 19:15:16 110327 |  TRACE   | Validating
2023/04/04 19:15:29 266153 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:15:29 266700 |  TRACE   |  - Start loss computation
2023/04/04 19:15:29 267138 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:17:05 331550 |  TRACE   |  - No improvement for loss: 0.21847 (current best: 0.21851)
2023/04/04 19:17:05 332009 |  TRACE   | Training for 250 steps (current step: 16500)
2023/04/04 19:22:42 391918 |  TRACE   | Validating
2023/04/04 19:22:55 297372 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:22:55 297859 |  TRACE   |  - Start loss computation
2023/04/04 19:22:55 298316 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:24:27 739192 |  TRACE   |  - New best loss: 0.21833
2023/04/04 19:24:27 739798 |  TRACE   |  - Improvement over previous best: -0.00018
2023/04/04 19:24:27 878463 |  TRACE   |  - Best model updated!
 
2023/04/04 19:24:27 878870 |  TRACE   | Training for 250 steps (current step: 16750)
2023/04/04 19:29:36 822426 |  TRACE   | Validating
2023/04/04 19:29:50 027335 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:29:50 027887 |  TRACE   |  - Start loss computation
2023/04/04 19:29:50 028310 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:31:22 856526 |  TRACE   |  - No improvement for loss: 0.21840 (current best: 0.21833)
2023/04/04 19:31:22 857022 |  TRACE   | Training for 250 steps (current step: 17000)
2023/04/04 19:36:41 234116 |  TRACE   | Validating
2023/04/04 19:36:54 171286 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:36:54 171845 |  TRACE   |  - Start loss computation
2023/04/04 19:36:54 172284 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:38:26 246957 |  TRACE   |  - No improvement for loss: 0.21830 (current best: 0.21833)
2023/04/04 19:38:26 247471 |  TRACE   | Training for 250 steps (current step: 17250)
2023/04/04 19:43:34 052652 |  TRACE   | Validating
2023/04/04 19:43:47 124537 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:43:47 125053 |  TRACE   |  - Start loss computation
2023/04/04 19:43:47 125478 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:45:19 945501 |  TRACE   |  - No improvement for loss: 0.21844 (current best: 0.21833)
2023/04/04 19:45:19 946006 |  TRACE   | Training for 250 steps (current step: 17500)
2023/04/04 19:50:47 288066 |  TRACE   | Validating
2023/04/04 19:51:00 585118 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:51:00 585692 |  TRACE   |  - Start loss computation
2023/04/04 19:51:00 586129 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:52:36 848927 |  TRACE   |  - No improvement for loss: 0.21835 (current best: 0.21833)
2023/04/04 19:52:36 849425 |  TRACE   | Training for 250 steps (current step: 17750)
2023/04/04 19:57:37 232593 |  TRACE   | Validating
2023/04/04 19:57:50 140030 |  TRACE   | Writing results to TensorBoard:
2023/04/04 19:57:50 140563 |  TRACE   |  - Start loss computation
2023/04/04 19:57:50 140985 |  TRACE   |  - Start image generation for 100 images
2023/04/04 19:59:24 701122 |  TRACE   |  - No improvement for loss: 0.21844 (current best: 0.21833)
2023/04/04 19:59:24 701650 |  TRACE   | Training for 250 steps (current step: 18000)
2023/04/04 20:04:49 850975 |  TRACE   | Validating
2023/04/04 20:05:02 826886 |  TRACE   | Writing results to TensorBoard:
2023/04/04 20:05:02 827418 |  TRACE   |  - Start loss computation
2023/04/04 20:05:02 827846 |  TRACE   |  - Start image generation for 100 images
2023/04/04 20:06:35 640695 |  TRACE   |  - No improvement for loss: 0.21837 (current best: 0.21833)
2023/04/04 20:06:35 641270 |  TRACE   | Training for 250 steps (current step: 18250)
2023/04/04 20:11:43 346301 |  TRACE   | Validating
2023/04/04 20:11:56 311986 |  TRACE   | Writing results to TensorBoard:
2023/04/04 20:11:56 312527 |  TRACE   |  - Start loss computation
2023/04/04 20:11:56 312947 |  TRACE   |  - Start image generation for 100 images
2023/04/04 20:13:28 048154 |  TRACE   |  - No improvement for loss: 0.21842 (current best: 0.21833)
2023/04/04 20:13:28 048659 |  TRACE   | Training for 250 steps (current step: 18500)
2023/04/04 20:19:07 252840 |  TRACE   | Validating
2023/04/04 20:19:20 135469 |  TRACE   | Writing results to TensorBoard:
2023/04/04 20:19:20 135993 |  TRACE   |  - Start loss computation
2023/04/04 20:19:20 136408 |  TRACE   |  - Start image generation for 100 images
2023/04/04 20:20:53 656456 |  TRACE   |  - No improvement for loss: 0.21835 (current best: 0.21833)
2023/04/04 20:20:53 656986 |  TRACE   | Training for 250 steps (current step: 18750)
2023/04/04 20:25:51 950634 |  TRACE   | Validating
2023/04/04 20:26:05 073057 |  TRACE   | Writing results to TensorBoard:
2023/04/04 20:26:05 073553 |  TRACE   |  - Start loss computation
2023/04/04 20:26:05 074036 |  TRACE   |  - Start image generation for 100 images
2023/04/04 20:27:40 883762 |  TRACE   |  - No improvement for loss: 0.21834 (current best: 0.21833)
2023/04/04 20:27:40 884269 |  TRACE   | Training for 250 steps (current step: 19000)
2023/04/04 20:33:33 715708 |  TRACE   | Validating
2023/04/04 20:33:47 218530 |  TRACE   | Writing results to TensorBoard:
2023/04/04 20:33:47 219112 |  TRACE   |  - Start loss computation
2023/04/04 20:33:47 219578 |  TRACE   |  - Start image generation for 100 images
2023/04/04 20:35:23 476741 |  TRACE   |  - No improvement for loss: 0.21848 (current best: 0.21833)
2023/04/04 20:35:23 477216 |  TRACE   |  - Early Stopping tolerance reached. Stopping training!
 
2023/04/04 20:35:23 731417 |  TRACE   | Start model evaluation
2023/04/04 20:45:31 073340 |  TRACE   | Avg prediction time per sample:  0.0028s
2023/04/04 20:45:31 190213 |  TRACE   | Evaluation results:
2023/04/04 20:45:31 190851 |  TRACE   |  - Results for field size: global
2023/04/04 20:45:31 191183 |  TRACE   |    - Precision: 56.57%
2023/04/04 20:45:31 191452 |  TRACE   |    - Recall: 48.13%
2023/04/04 20:45:31 191616 |  TRACE   |  - Results for field size: small
2023/04/04 20:45:31 191837 |  TRACE   |    - Precision: 39.39%
2023/04/04 20:45:31 192068 |  TRACE   |    - Recall: 22.40%
2023/04/04 20:45:31 192223 |  TRACE   |  - Results for field size: medium
2023/04/04 20:45:31 192437 |  TRACE   |    - Precision: 61.20%
2023/04/04 20:45:31 192663 |  TRACE   |    - Recall: 49.87%
2023/04/04 20:45:31 192814 |  TRACE   |  - Results for field size: large
2023/04/04 20:45:31 193024 |  TRACE   |    - Precision: 66.40%
2023/04/04 20:45:31 193251 |  TRACE   |    - Recall: 61.57%
2023/04/04 20:45:31 193402 |  TRACE   |  - Results for field size: extra large
2023/04/04 20:45:31 193608 |  TRACE   |    - Precision: 60.17%
2023/04/04 20:45:31 193823 |  TRACE   |    - Recall: 67.14%
