Skip to content

Instantly share code, notes, and snippets.

@mli
Created November 26, 2016 04:47
Show Gist options
  • Save mli/900b810258e2e0bc26fa606977a3b043 to your computer and use it in GitHub Desktop.
Save mli/900b810258e2e0bc26fa606977a3b043 to your computer and use it in GitHub Desktop.
training log
~/mxnet/example/image-classification $ python fine-tune.py --pretrained-model imagenet11k-resnet-152 --gpus 0,1,2,3,4,5,6,7 --data-train data/caltech256-train.rec --data-val data/caltech256-val.rec --batch-size 128 --num-classes 256 --num-examples 15240
libdc1394 error: Failed to initialize libdc1394
INFO:root:start with arguments Namespace(batch_size=128, benchmark=0, data_train='data/caltech256-train.rec', data_val='data/caltech256-val.rec', disp_batches=20, gpus='0,1,2,3,4,5,6,7', image_shape='3,224,224', kv_store='device', layer_before_fullc='flatten0', load_epoch=None, lr=0.01, lr_factor=0.1, lr_step_epochs='20', max_random_aspect_ratio=0, max_random_h=0, max_random_l=0, max_random_rotate_angle=0, max_random_s=0, max_random_scale=1, max_random_shear_ratio=0, min_random_scale=1, model_prefix=None, mom=0, network=None, num_classes=256, num_epochs=30, num_examples=15240, num_layers=None, optimizer='sgd', pad_size=0, pretrained_model='imagenet11k-resnet-152', random_crop=1, random_mirror=1, rgb_mean='123.68,116.779,103.939', test_io=0, top_k=0, wd=0)
[23:10:19] src/io/iter_image_recordio.cc:219: ImageRecordIOParser: data/caltech256-train.rec, use 15 threads for decoding..
[23:10:19] src/io/iter_image_recordio.cc:219: ImageRecordIOParser: data/caltech256-val.rec, use 4 threads for decoding..
INFO:root:Start training with [gpu(0), gpu(1), gpu(2), gpu(3), gpu(4), gpu(5), gpu(6), gpu(7)]
INFO:root:Epoch[0] Batch [20] Speed: 155.99 samples/sec Train-accuracy=0.182031
INFO:root:Epoch[0] Batch [40] Speed: 146.38 samples/sec Train-accuracy=0.571094
INFO:root:Epoch[0] Batch [60] Speed: 145.01 samples/sec Train-accuracy=0.734766
INFO:root:Epoch[0] Batch [80] Speed: 143.61 samples/sec Train-accuracy=0.782813
INFO:root:Epoch[0] Batch [100] Speed: 144.82 samples/sec Train-accuracy=0.819531
INFO:root:Epoch[0] Batch [120] Speed: 146.03 samples/sec Train-accuracy=0.839844
INFO:root:Epoch[0] Resetting Data Iterator
INFO:root:Epoch[0] Time cost=125.734
INFO:root:Epoch[0] Validation-accuracy=0.836266
INFO:root:Epoch[1] Batch [20] Speed: 153.14 samples/sec Train-accuracy=0.858203
INFO:root:Epoch[1] Batch [40] Speed: 145.62 samples/sec Train-accuracy=0.879297
INFO:root:Epoch[1] Batch [60] Speed: 145.30 samples/sec Train-accuracy=0.883984
INFO:root:Epoch[1] Batch [80] Speed: 145.37 samples/sec Train-accuracy=0.905859
INFO:root:Epoch[1] Batch [100] Speed: 145.73 samples/sec Train-accuracy=0.905859
INFO:root:Epoch[1] Batch [120] Speed: 145.19 samples/sec Train-accuracy=0.901953
INFO:root:Epoch[1] Resetting Data Iterator
INFO:root:Epoch[1] Time cost=105.030
INFO:root:Epoch[1] Validation-accuracy=0.850775
INFO:root:Epoch[2] Batch [20] Speed: 152.95 samples/sec Train-accuracy=0.915234
INFO:root:Epoch[2] Batch [40] Speed: 145.60 samples/sec Train-accuracy=0.920703
INFO:root:Epoch[2] Batch [60] Speed: 145.16 samples/sec Train-accuracy=0.930469
INFO:root:Epoch[2] Batch [80] Speed: 145.03 samples/sec Train-accuracy=0.936328
INFO:root:Epoch[2] Batch [100] Speed: 145.56 samples/sec Train-accuracy=0.939453
INFO:root:Epoch[2] Batch [120] Speed: 145.56 samples/sec Train-accuracy=0.943359
INFO:root:Epoch[2] Resetting Data Iterator
INFO:root:Epoch[2] Time cost=105.955
INFO:root:Epoch[2] Validation-accuracy=0.859966
INFO:root:Epoch[3] Batch [20] Speed: 152.45 samples/sec Train-accuracy=0.950000
INFO:root:Epoch[3] Batch [40] Speed: 145.47 samples/sec Train-accuracy=0.945312
INFO:root:Epoch[3] Batch [60] Speed: 145.69 samples/sec Train-accuracy=0.950781
INFO:root:Epoch[3] Batch [80] Speed: 145.22 samples/sec Train-accuracy=0.957031
INFO:root:Epoch[3] Batch [100] Speed: 145.26 samples/sec Train-accuracy=0.958203
INFO:root:Epoch[3] Batch [120] Speed: 145.13 samples/sec Train-accuracy=0.958594
INFO:root:Epoch[3] Resetting Data Iterator
INFO:root:Epoch[3] Time cost=105.149
INFO:root:Epoch[3] Validation-accuracy=0.860688
INFO:root:Epoch[4] Batch [20] Speed: 152.74 samples/sec Train-accuracy=0.958203
INFO:root:Epoch[4] Batch [40] Speed: 145.46 samples/sec Train-accuracy=0.959766
INFO:root:Epoch[4] Batch [60] Speed: 145.49 samples/sec Train-accuracy=0.961719
INFO:root:Epoch[4] Batch [80] Speed: 145.16 samples/sec Train-accuracy=0.975000
INFO:root:Epoch[4] Batch [100] Speed: 145.49 samples/sec Train-accuracy=0.968359
INFO:root:Epoch[4] Batch [120] Speed: 145.75 samples/sec Train-accuracy=0.966016
INFO:root:Epoch[4] Resetting Data Iterator
INFO:root:Epoch[4] Time cost=105.911
INFO:root:Epoch[4] Validation-accuracy=0.862067
INFO:root:Epoch[5] Batch [20] Speed: 152.75 samples/sec Train-accuracy=0.973828
INFO:root:Epoch[5] Batch [40] Speed: 145.66 samples/sec Train-accuracy=0.969141
INFO:root:Epoch[5] Batch [60] Speed: 145.19 samples/sec Train-accuracy=0.968750
INFO:root:Epoch[5] Batch [80] Speed: 145.59 samples/sec Train-accuracy=0.974219
INFO:root:Epoch[5] Batch [100] Speed: 145.56 samples/sec Train-accuracy=0.969531
INFO:root:Epoch[5] Batch [120] Speed: 145.29 samples/sec Train-accuracy=0.967187
INFO:root:Epoch[5] Resetting Data Iterator
INFO:root:Epoch[5] Time cost=105.061
INFO:root:Epoch[5] Validation-accuracy=0.863642
INFO:root:Epoch[6] Batch [20] Speed: 153.49 samples/sec Train-accuracy=0.970703
INFO:root:Epoch[6] Batch [40] Speed: 145.19 samples/sec Train-accuracy=0.976172
INFO:root:Epoch[6] Batch [60] Speed: 145.64 samples/sec Train-accuracy=0.976562
INFO:root:Epoch[6] Batch [80] Speed: 145.30 samples/sec Train-accuracy=0.980469
INFO:root:Epoch[6] Batch [100] Speed: 145.37 samples/sec Train-accuracy=0.975781
INFO:root:Epoch[6] Batch [120] Speed: 145.29 samples/sec Train-accuracy=0.974219
INFO:root:Epoch[6] Resetting Data Iterator
INFO:root:Epoch[6] Time cost=105.922
INFO:root:Epoch[6] Validation-accuracy=0.865481
INFO:root:Epoch[7] Batch [20] Speed: 152.83 samples/sec Train-accuracy=0.982422
INFO:root:Epoch[7] Batch [40] Speed: 145.26 samples/sec Train-accuracy=0.978516
INFO:root:Epoch[7] Batch [60] Speed: 145.74 samples/sec Train-accuracy=0.979688
INFO:root:Epoch[7] Batch [80] Speed: 145.40 samples/sec Train-accuracy=0.983203
INFO:root:Epoch[7] Batch [100] Speed: 145.60 samples/sec Train-accuracy=0.975781
INFO:root:Epoch[7] Batch [120] Speed: 145.33 samples/sec Train-accuracy=0.980078
INFO:root:Epoch[7] Resetting Data Iterator
INFO:root:Epoch[7] Time cost=105.046
INFO:root:Epoch[7] Validation-accuracy=0.862001
INFO:root:Epoch[8] Batch [20] Speed: 153.05 samples/sec Train-accuracy=0.985156
INFO:root:Epoch[8] Batch [40] Speed: 145.57 samples/sec Train-accuracy=0.979297
INFO:root:Epoch[8] Batch [60] Speed: 145.36 samples/sec Train-accuracy=0.978906
INFO:root:Epoch[8] Batch [80] Speed: 145.06 samples/sec Train-accuracy=0.984375
INFO:root:Epoch[8] Batch [100] Speed: 145.47 samples/sec Train-accuracy=0.984766
INFO:root:Epoch[8] Batch [120] Speed: 144.98 samples/sec Train-accuracy=0.984766
INFO:root:Epoch[8] Resetting Data Iterator
INFO:root:Epoch[8] Time cost=106.032
INFO:root:Epoch[8] Validation-accuracy=0.862855
INFO:root:Epoch[9] Batch [20] Speed: 152.51 samples/sec Train-accuracy=0.983203
INFO:root:Epoch[9] Batch [40] Speed: 145.75 samples/sec Train-accuracy=0.986719
INFO:root:Epoch[9] Batch [60] Speed: 145.32 samples/sec Train-accuracy=0.984375
INFO:root:Epoch[9] Batch [80] Speed: 145.25 samples/sec Train-accuracy=0.985938
INFO:root:Epoch[9] Batch [100] Speed: 145.88 samples/sec Train-accuracy=0.983203
INFO:root:Epoch[9] Batch [120] Speed: 145.20 samples/sec Train-accuracy=0.984766
INFO:root:Epoch[9] Resetting Data Iterator
INFO:root:Epoch[9] Time cost=105.061
INFO:root:Epoch[9] Validation-accuracy=0.864430
INFO:root:Epoch[10] Batch [20] Speed: 152.90 samples/sec Train-accuracy=0.986719
INFO:root:Epoch[10] Batch [40] Speed: 145.22 samples/sec Train-accuracy=0.988672
INFO:root:Epoch[10] Batch [60] Speed: 145.09 samples/sec Train-accuracy=0.985547
INFO:root:Epoch[10] Batch [80] Speed: 145.67 samples/sec Train-accuracy=0.986328
INFO:root:Epoch[10] Batch [100] Speed: 145.64 samples/sec Train-accuracy=0.991016
INFO:root:Epoch[10] Batch [120] Speed: 145.22 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[10] Resetting Data Iterator
INFO:root:Epoch[10] Time cost=106.001
INFO:root:Epoch[10] Validation-accuracy=0.863971
INFO:root:Epoch[11] Batch [20] Speed: 153.22 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[11] Batch [40] Speed: 145.10 samples/sec Train-accuracy=0.987891
INFO:root:Epoch[11] Batch [60] Speed: 145.27 samples/sec Train-accuracy=0.988281
INFO:root:Epoch[11] Batch [80] Speed: 144.81 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[11] Batch [100] Speed: 145.78 samples/sec Train-accuracy=0.986719
INFO:root:Epoch[11] Batch [120] Speed: 145.26 samples/sec Train-accuracy=0.987891
INFO:root:Epoch[11] Resetting Data Iterator
INFO:root:Epoch[11] Time cost=105.140
INFO:root:Epoch[11] Validation-accuracy=0.867975
INFO:root:Epoch[12] Batch [20] Speed: 152.72 samples/sec Train-accuracy=0.989844
INFO:root:Epoch[12] Batch [40] Speed: 145.15 samples/sec Train-accuracy=0.990625
INFO:root:Epoch[12] Batch [60] Speed: 145.47 samples/sec Train-accuracy=0.986719
INFO:root:Epoch[12] Batch [80] Speed: 145.01 samples/sec Train-accuracy=0.990234
INFO:root:Epoch[12] Batch [100] Speed: 145.55 samples/sec Train-accuracy=0.990625
INFO:root:Epoch[12] Batch [120] Speed: 145.53 samples/sec Train-accuracy=0.986719
INFO:root:Epoch[12] Resetting Data Iterator
INFO:root:Epoch[12] Time cost=106.025
INFO:root:Epoch[12] Validation-accuracy=0.862329
INFO:root:Epoch[13] Batch [20] Speed: 152.76 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[13] Batch [40] Speed: 145.10 samples/sec Train-accuracy=0.991406
INFO:root:Epoch[13] Batch [60] Speed: 145.21 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[13] Batch [80] Speed: 145.24 samples/sec Train-accuracy=0.990625
INFO:root:Epoch[13] Batch [100] Speed: 145.59 samples/sec Train-accuracy=0.984766
INFO:root:Epoch[13] Batch [120] Speed: 145.48 samples/sec Train-accuracy=0.985938
INFO:root:Epoch[13] Resetting Data Iterator
INFO:root:Epoch[13] Time cost=105.140
INFO:root:Epoch[13] Validation-accuracy=0.866137
INFO:root:Epoch[14] Batch [20] Speed: 152.95 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[14] Batch [40] Speed: 145.52 samples/sec Train-accuracy=0.990234
INFO:root:Epoch[14] Batch [60] Speed: 145.46 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[14] Batch [80] Speed: 145.43 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[14] Batch [100] Speed: 145.81 samples/sec Train-accuracy=0.990234
INFO:root:Epoch[14] Batch [120] Speed: 145.58 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[14] Resetting Data Iterator
INFO:root:Epoch[14] Time cost=105.873
INFO:root:Epoch[14] Validation-accuracy=0.866006
INFO:root:Epoch[15] Batch [20] Speed: 152.32 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[15] Batch [40] Speed: 145.26 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[15] Batch [60] Speed: 145.37 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[15] Batch [80] Speed: 145.21 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[15] Batch [100] Speed: 145.82 samples/sec Train-accuracy=0.989844
INFO:root:Epoch[15] Batch [120] Speed: 145.55 samples/sec Train-accuracy=0.992578
INFO:root:Epoch[15] Resetting Data Iterator
INFO:root:Epoch[15] Time cost=105.111
INFO:root:Epoch[15] Validation-accuracy=0.867319
INFO:root:Epoch[16] Batch [20] Speed: 152.92 samples/sec Train-accuracy=0.994922
INFO:root:Epoch[16] Batch [40] Speed: 145.22 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[16] Batch [60] Speed: 144.94 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[16] Batch [80] Speed: 145.22 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[16] Batch [100] Speed: 145.50 samples/sec Train-accuracy=0.989453
INFO:root:Epoch[16] Batch [120] Speed: 145.62 samples/sec Train-accuracy=0.992188
INFO:root:Epoch[16] Resetting Data Iterator
INFO:root:Epoch[16] Time cost=105.148
INFO:root:Epoch[16] Validation-accuracy=0.866071
INFO:root:Epoch[17] Batch [20] Speed: 152.76 samples/sec Train-accuracy=0.991406
INFO:root:Epoch[17] Batch [40] Speed: 144.94 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[17] Batch [60] Speed: 145.48 samples/sec Train-accuracy=0.989844
INFO:root:Epoch[17] Batch [80] Speed: 145.51 samples/sec Train-accuracy=0.993750
INFO:root:Epoch[17] Batch [100] Speed: 145.41 samples/sec Train-accuracy=0.993750
INFO:root:Epoch[17] Batch [120] Speed: 145.66 samples/sec Train-accuracy=0.990625
INFO:root:Epoch[17] Resetting Data Iterator
INFO:root:Epoch[17] Time cost=105.968
INFO:root:Epoch[17] Validation-accuracy=0.866400
INFO:root:Epoch[18] Batch [20] Speed: 152.74 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[18] Batch [40] Speed: 145.20 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[18] Batch [60] Speed: 145.23 samples/sec Train-accuracy=0.991406
INFO:root:Epoch[18] Batch [80] Speed: 145.41 samples/sec Train-accuracy=0.991406
INFO:root:Epoch[18] Batch [100] Speed: 145.61 samples/sec Train-accuracy=0.991406
INFO:root:Epoch[18] Batch [120] Speed: 145.25 samples/sec Train-accuracy=0.989062
INFO:root:Epoch[18] Resetting Data Iterator
INFO:root:Epoch[18] Time cost=105.136
INFO:root:Epoch[18] Validation-accuracy=0.864561
INFO:root:Epoch[19] Batch [20] Speed: 153.03 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[19] Batch [40] Speed: 145.19 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[19] Batch [60] Speed: 145.35 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[19] Batch [80] Speed: 140.18 samples/sec Train-accuracy=0.992578
INFO:root:Update[2381]: Change learning rate to 1.00000e-03
INFO:root:Epoch[19] Batch [100] Speed: 145.55 samples/sec Train-accuracy=0.994922
INFO:root:Epoch[19] Batch [120] Speed: 145.46 samples/sec Train-accuracy=0.992188
INFO:root:Epoch[19] Resetting Data Iterator
INFO:root:Epoch[19] Time cost=106.585
INFO:root:Epoch[19] Validation-accuracy=0.868369
INFO:root:Epoch[20] Batch [20] Speed: 152.71 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[20] Batch [40] Speed: 145.22 samples/sec Train-accuracy=0.995703
INFO:root:Epoch[20] Batch [60] Speed: 145.23 samples/sec Train-accuracy=0.992188
INFO:root:Epoch[20] Batch [80] Speed: 145.18 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[20] Batch [100] Speed: 145.67 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[20] Batch [120] Speed: 145.51 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[20] Resetting Data Iterator
INFO:root:Epoch[20] Time cost=105.126
INFO:root:Epoch[20] Validation-accuracy=0.870011
INFO:root:Epoch[21] Batch [20] Speed: 153.20 samples/sec Train-accuracy=0.993750
INFO:root:Epoch[21] Batch [40] Speed: 145.03 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[21] Batch [60] Speed: 145.53 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[21] Batch [80] Speed: 144.84 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[21] Batch [100] Speed: 145.88 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[21] Batch [120] Speed: 145.13 samples/sec Train-accuracy=0.992188
INFO:root:Epoch[21] Resetting Data Iterator
INFO:root:Epoch[21] Time cost=106.003
INFO:root:Epoch[21] Validation-accuracy=0.870076
INFO:root:Epoch[22] Batch [20] Speed: 153.16 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[22] Batch [40] Speed: 145.15 samples/sec Train-accuracy=0.997266
INFO:root:Epoch[22] Batch [60] Speed: 145.37 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[22] Batch [80] Speed: 145.26 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[22] Batch [100] Speed: 145.51 samples/sec Train-accuracy=0.993750
INFO:root:Epoch[22] Batch [120] Speed: 145.23 samples/sec Train-accuracy=0.994922
INFO:root:Epoch[22] Resetting Data Iterator
INFO:root:Epoch[22] Time cost=105.108
INFO:root:Epoch[22] Validation-accuracy=0.870404
INFO:root:Epoch[23] Batch [20] Speed: 153.37 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[23] Batch [40] Speed: 145.51 samples/sec Train-accuracy=0.996094
INFO:root:Epoch[23] Batch [60] Speed: 145.06 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[23] Batch [80] Speed: 145.35 samples/sec Train-accuracy=0.994922
INFO:root:Epoch[23] Batch [100] Speed: 145.30 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[23] Batch [120] Speed: 145.71 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[23] Resetting Data Iterator
INFO:root:Epoch[23] Time cost=105.913
INFO:root:Epoch[23] Validation-accuracy=0.871127
INFO:root:Epoch[24] Batch [20] Speed: 153.23 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[24] Batch [40] Speed: 145.69 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[24] Batch [60] Speed: 145.33 samples/sec Train-accuracy=0.992188
INFO:root:Epoch[24] Batch [80] Speed: 145.41 samples/sec Train-accuracy=0.996094
INFO:root:Epoch[24] Batch [100] Speed: 145.50 samples/sec Train-accuracy=0.993750
INFO:root:Epoch[24] Batch [120] Speed: 145.50 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[24] Resetting Data Iterator
INFO:root:Epoch[24] Time cost=104.988
INFO:root:Epoch[24] Validation-accuracy=0.870930
INFO:root:Epoch[25] Batch [20] Speed: 152.97 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[25] Batch [40] Speed: 144.92 samples/sec Train-accuracy=0.996094
INFO:root:Epoch[25] Batch [60] Speed: 145.03 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[25] Batch [80] Speed: 145.42 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[25] Batch [100] Speed: 145.66 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[25] Batch [120] Speed: 145.28 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[25] Resetting Data Iterator
INFO:root:Epoch[25] Time cost=106.041
INFO:root:Epoch[25] Validation-accuracy=0.870733
INFO:root:Epoch[26] Batch [20] Speed: 153.29 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[26] Batch [40] Speed: 145.27 samples/sec Train-accuracy=0.996875
INFO:root:Epoch[26] Batch [60] Speed: 145.38 samples/sec Train-accuracy=0.992969
INFO:root:Epoch[26] Batch [80] Speed: 145.37 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[26] Batch [100] Speed: 145.19 samples/sec Train-accuracy=0.994922
INFO:root:Epoch[26] Batch [120] Speed: 144.66 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[26] Resetting Data Iterator
INFO:root:Epoch[26] Time cost=105.171
INFO:root:Epoch[26] Validation-accuracy=0.871652
INFO:root:Epoch[27] Batch [20] Speed: 153.00 samples/sec Train-accuracy=0.996094
INFO:root:Epoch[27] Batch [40] Speed: 145.60 samples/sec Train-accuracy=0.995703
INFO:root:Epoch[27] Batch [60] Speed: 145.11 samples/sec Train-accuracy=0.991797
INFO:root:Epoch[27] Batch [80] Speed: 145.65 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[27] Batch [100] Speed: 145.37 samples/sec Train-accuracy=0.994531
INFO:root:Epoch[27] Batch [120] Speed: 145.43 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[27] Resetting Data Iterator
INFO:root:Epoch[27] Time cost=105.930
INFO:root:Epoch[27] Validation-accuracy=0.872046
INFO:root:Epoch[28] Batch [20] Speed: 152.46 samples/sec Train-accuracy=0.996484
INFO:root:Epoch[28] Batch [40] Speed: 145.22 samples/sec Train-accuracy=0.996484
INFO:root:Epoch[28] Batch [60] Speed: 145.35 samples/sec Train-accuracy=0.993750
INFO:root:Epoch[28] Batch [80] Speed: 145.07 samples/sec Train-accuracy=0.996094
INFO:root:Epoch[28] Batch [100] Speed: 145.40 samples/sec Train-accuracy=0.994922
INFO:root:Epoch[28] Batch [120] Speed: 145.64 samples/sec Train-accuracy=0.994141
INFO:root:Epoch[28] Resetting Data Iterator
INFO:root:Epoch[28] Time cost=105.155
INFO:root:Epoch[28] Validation-accuracy=0.871849
INFO:root:Epoch[29] Batch [20] Speed: 152.68 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[29] Batch [40] Speed: 145.15 samples/sec Train-accuracy=0.997656
INFO:root:Epoch[29] Batch [60] Speed: 145.51 samples/sec Train-accuracy=0.992188
INFO:root:Epoch[29] Batch [80] Speed: 145.36 samples/sec Train-accuracy=0.995313
INFO:root:Epoch[29] Batch [100] Speed: 145.65 samples/sec Train-accuracy=0.995703
INFO:root:Epoch[29] Batch [120] Speed: 145.63 samples/sec Train-accuracy=0.993359
INFO:root:Epoch[29] Resetting Data Iterator
INFO:root:Epoch[29] Time cost=105.947
INFO:root:Epoch[29] Validation-accuracy=0.872440
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment