Skip to content

Instantly share code, notes, and snippets.

@ssss1029

ssss1029/ResNeXt_smaug

Created September 17, 2020 19:20
Show Gist options
  • Save ssss1029/267cb8ad40148887bd0deb66f3f295b6 to your computer and use it in GitHub Desktop.
Save ssss1029/267cb8ad40148887bd0deb66f3f295b6 to your computer and use it in GitHub Desktop.
Download ZIP
ResNeXt --batch-size=120 --lr=0.01 --gradient-accumulation-steps=3 (Effective Batch Size is then 360 (1080 including the 3x from AugMix)
Raw
ResNeXt_smaug
Epoch: [0][ 7630/21352] Time 1.768 ( 2.713) Data 0.000 ( 0.067) Loss 6.2701e-01 (7.4326e-01) Acc@1 60.00 ( 61.05) Acc@5 86.67 ( 80.43) [1868/1868]
Epoch: [0][ 7640/21352] Time 2.724 ( 2.713) Data 0.001 ( 0.075) Loss 6.2641e-01 (7.4508e-01) Acc@1 61.67 ( 61.01) Acc@5 88.33 ( 80.35)
Epoch: [0][ 7640/21352] Time 2.691 ( 2.713) Data 0.001 ( 0.067) Loss 6.2034e-01 (7.4316e-01) Acc@1 65.00 ( 61.05) Acc@5 86.67 ( 80.44)
Epoch: [0][ 7650/21352] Time 3.767 ( 2.713) Data 0.001 ( 0.075) Loss 7.1818e-01 (7.4511e-01) Acc@1 61.67 ( 61.01) Acc@5 76.67 ( 80.35)
Epoch: [0][ 7650/21352] Time 3.647 ( 2.713) Data 0.000 ( 0.067) Loss 6.9878e-01 (7.4314e-01) Acc@1 60.00 ( 61.05) Acc@5 80.00 ( 80.44)
Epoch: [0][ 7660/21352] Time 1.645 ( 2.713) Data 0.000 ( 0.075) Loss 9.9575e-01 (7.4507e-01) Acc@1 51.67 ( 61.01) Acc@5 71.67 ( 80.35)
Epoch: [0][ 7660/21352] Time 1.768 ( 2.713) Data 0.000 ( 0.067) Loss 5.8892e-01 (7.4310e-01) Acc@1 65.00 ( 61.05) Acc@5 88.33 ( 80.44)
Epoch: [0][ 7670/21352] Time 2.686 ( 2.713) Data 0.000 ( 0.075) Loss 7.2001e-01 (7.4503e-01) Acc@1 55.00 ( 61.02) Acc@5 80.00 ( 80.35)
Epoch: [0][ 7670/21352] Time 2.690 ( 2.713) Data 0.000 ( 0.067) Loss 7.7231e-01 (7.4307e-01) Acc@1 55.00 ( 61.05) Acc@5 81.67 ( 80.44)
Epoch: [0][ 7680/21352] Time 3.762 ( 2.713) Data 0.000 ( 0.075) Loss 8.0344e-01 (7.4497e-01) Acc@1 51.67 ( 61.01) Acc@5 75.00 ( 80.35)
Epoch: [0][ 7680/21352] Time 3.649 ( 2.713) Data 0.000 ( 0.067) Loss 9.1163e-01 (7.4304e-01) Acc@1 55.00 ( 61.05) Acc@5 73.33 ( 80.44)
Epoch: [0][ 7690/21352] Time 1.643 ( 2.713) Data 0.000 ( 0.075) Loss 5.3604e-01 (7.4487e-01) Acc@1 70.00 ( 61.02) Acc@5 93.33 ( 80.35)
Epoch: [0][ 7690/21352] Time 1.784 ( 2.713) Data 0.000 ( 0.067) Loss 7.1967e-01 (7.4307e-01) Acc@1 60.00 ( 61.04) Acc@5 83.33 ( 80.44)
Epoch: [0][ 7700/21352] Time 2.725 ( 2.713) Data 0.001 ( 0.075) Loss 7.0432e-01 (7.4488e-01) Acc@1 58.33 ( 61.02) Acc@5 78.33 ( 80.35)
Epoch: [0][ 7700/21352] Time 2.695 ( 2.713) Data 0.001 ( 0.067) Loss 7.0394e-01 (7.4306e-01) Acc@1 66.67 ( 61.04) Acc@5 83.33 ( 80.44)
Epoch: [0][ 7710/21352] Time 3.757 ( 2.713) Data 0.000 ( 0.075) Loss 6.5058e-01 (7.4479e-01) Acc@1 66.67 ( 61.02) Acc@5 86.67 ( 80.36)
Epoch: [0][ 7710/21352] Time 3.637 ( 2.713) Data 0.001 ( 0.067) Loss 7.6383e-01 (7.4308e-01) Acc@1 60.00 ( 61.04) Acc@5 76.67 ( 80.44)
Epoch: [0][ 7720/21352] Time 1.640 ( 2.712) Data 0.000 ( 0.075) Loss 6.3972e-01 (7.4471e-01) Acc@1 58.33 ( 61.02) Acc@5 83.33 ( 80.36)
Epoch: [0][ 7720/21352] Time 1.782 ( 2.713) Data 0.000 ( 0.067) Loss 6.3190e-01 (7.4302e-01) Acc@1 70.00 ( 61.04) Acc@5 86.67 ( 80.44)
.....
Epoch: [0][17020/21352] Time 1.640 ( 2.708) Data 0.000 ( 0.073) Loss 7.9896e-01 (7.2126e-01) Acc@1 61.67 ( 61.42) Acc@5 73.33 ( 80.82)
Epoch: [0][17020/21352] Time 1.766 ( 2.708) Data 0.000 ( 0.065) Loss 6.0291e-01 (7.2042e-01) Acc@1 60.00 ( 61.41) Acc@5 85.00 ( 80.86)
Epoch: [0][17030/21352] Time 2.709 ( 2.708) Data 0.001 ( 0.073) Loss 6.7774e-01 (7.2125e-01) Acc@1 61.67 ( 61.42) Acc@5 80.00 ( 80.82)
Epoch: [0][17030/21352] Time 2.700 ( 2.708) Data 0.001 ( 0.065) Loss 6.8591e-01 (7.2041e-01) Acc@1 61.67 ( 61.41) Acc@5 80.00 ( 80.86)
Epoch: [0][17040/21352] Time 3.755 ( 2.708) Data 0.001 ( 0.073) Loss 7.7442e-01 (7.2122e-01) Acc@1 56.67 ( 61.42) Acc@5 75.00 ( 80.82)
Epoch: [0][17040/21352] Time 3.637 ( 2.708) Data 0.000 ( 0.065) Loss 5.6260e-01 (7.2038e-01) Acc@1 61.67 ( 61.41) Acc@5 78.33 ( 80.86)
Epoch: [0][17050/21352] Time 1.640 ( 2.708) Data 0.000 ( 0.073) Loss 6.3643e-01 (7.2121e-01) Acc@1 61.67 ( 61.42) Acc@5 85.00 ( 80.82)
Epoch: [0][17050/21352] Time 1.772 ( 2.708) Data 0.000 ( 0.065) Loss 5.8291e-01 (7.2037e-01) Acc@1 66.67 ( 61.41) Acc@5 85.00 ( 80.86)
Epoch: [0][17060/21352] Time 2.686 ( 2.708) Data 0.001 ( 0.073) Loss 7.7155e-01 (7.2121e-01) Acc@1 58.33 ( 61.42) Acc@5 81.67 ( 80.82)
Epoch: [0][17060/21352] Time 2.690 ( 2.708) Data 0.001 ( 0.065) Loss 7.3567e-01 (7.2036e-01) Acc@1 60.00 ( 61.41) Acc@5 80.00 ( 80.86)
Epoch: [0][17070/21352] Time 3.758 ( 2.708) Data 0.001 ( 0.073) Loss 8.4555e-01 (7.2121e-01) Acc@1 53.33 ( 61.42) Acc@5 76.67 ( 80.82)
Epoch: [0][17070/21352] Time 3.637 ( 2.708) Data 0.000 ( 0.065) Loss 6.8495e-01 (7.2032e-01) Acc@1 70.00 ( 61.41) Acc@5 80.00 ( 80.86)
Epoch: [0][17080/21352] Time 1.675 ( 2.708) Data 0.000 ( 0.073) Loss 7.4875e-01 (7.2119e-01) Acc@1 68.33 ( 61.42) Acc@5 83.33 ( 80.82)
Epoch: [0][17080/21352] Time 1.788 ( 2.708) Data 0.000 ( 0.065) Loss 7.6923e-01 (7.2031e-01) Acc@1 50.00 ( 61.41) Acc@5 73.33 ( 80.86)
Epoch: [0][17090/21352] Time 2.694 ( 2.708) Data 0.000 ( 0.073) Loss 6.3803e-01 (7.2120e-01) Acc@1 60.00 ( 61.42) Acc@5 86.67 ( 80.82)
Epoch: [0][17090/21352] Time 2.692 ( 2.708) Data 0.000 ( 0.065) Loss 5.7326e-01 (7.2029e-01) Acc@1 61.67 ( 61.41) Acc@5 85.00 ( 80.86)
Epoch: [0][17100/21352] Time 3.758 ( 2.708) Data 0.000 ( 0.073) Loss 7.7385e-01 (7.2118e-01) Acc@1 58.33 ( 61.42) Acc@5 73.33 ( 80.82)
Epoch: [0][17100/21352] Time 3.638 ( 2.708) Data 0.000 ( 0.065) Loss 5.8939e-01 (7.2027e-01) Acc@1 70.00 ( 61.41) Acc@5 90.00 ( 80.86)
Epoch: [0][17110/21352] Time 1.652 ( 2.708) Data 0.000 ( 0.073) Loss 8.5003e-01 (7.2117e-01) Acc@1 53.33 ( 61.42) Acc@5 70.00 ( 80.82)
Epoch: [0][17110/21352] Time 1.800 ( 2.708) Data 0.000 ( 0.065) Loss 7.1127e-01 (7.2024e-01) Acc@1 60.00 ( 61.42) Acc@5 76.67 ( 80.86)
Epoch: [0][17120/21352] Time 2.698 ( 2.708) Data 0.001 ( 0.073) Loss 6.3944e-01 (7.2115e-01) Acc@1 65.00 ( 61.42) Acc@5 83.33 ( 80.82)
Epoch: [0][17120/21352] Time 2.693 ( 2.708) Data 0.000 ( 0.065) Loss 7.2371e-01 (7.2022e-01) Acc@1 63.33 ( 61.42) Acc@5 76.67 ( 80.86)
Epoch: [0][17130/21352] Time 3.760 ( 2.708) Data 0.000 ( 0.073) Loss 6.3151e-01 (7.2112e-01) Acc@1 73.33 ( 61.42) Acc@5 81.67 ( 80.82)
Epoch: [0][17130/21352] Time 3.639 ( 2.708) Data 0.000 ( 0.065) Loss 9.8663e-01 (7.2024e-01) Acc@1 50.00 ( 61.41) Acc@5 65.00 ( 80.86)
Epoch: [0][17140/21352] Time 1.660 ( 2.708) Data 0.000 ( 0.073) Loss 7.2971e-01 (7.2110e-01) Acc@1 61.67 ( 61.42) Acc@5 78.33 ( 80.82)
Epoch: [0][17140/21352] Time 1.780 ( 2.708) Data 0.000 ( 0.065) Loss 6.5033e-01 (7.2020e-01) Acc@1 61.67 ( 61.42) Acc@5 85.00 ( 80.86)
Epoch: [0][17150/21352] Time 2.691 ( 2.708) Data 0.001 ( 0.073) Loss 7.1474e-01 (7.2110e-01) Acc@1 60.00 ( 61.42) Acc@5 78.33 ( 80.82)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment