Refine acc actor

[liujuncheng]

No description provided.

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

OneFlow resnet50 time: 136.4ms (= 6818.6ms / 50, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 139.8ms (= 6988.3ms / 50, input_shape=[16, 3, 224, 224])
❌ Relative speed: 1.02 (= 139.8ms / 136.4ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 78.2ms (= 3907.6ms / 50, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 85.9ms (= 4293.4ms / 50, input_shape=[8, 3, 224, 224])
✔️ Relative speed: 1.10 (= 85.9ms / 78.2ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 50.5ms (= 2527.0ms / 50, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 57.9ms (= 2893.0ms / 50, input_shape=[4, 3, 224, 224])
✔️ Relative speed: 1.14 (= 57.9ms / 50.5ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 51.3ms (= 2567.4ms / 50, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 49.8ms (= 2490.3ms / 50, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 0.97 (= 49.8ms / 51.3ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 50.2ms (= 2512.1ms / 50, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 42.5ms (= 2125.1ms / 50, input_shape=[1, 3, 224, 224])
❌ Relative speed: 0.85 (= 42.5ms / 50.2ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 153.7ms (= 7687.2ms / 50, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 159.4ms (= 7972.2ms / 50, input_shape=[16, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.04 (= 159.4ms / 153.7ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 104.6ms (= 5228.5ms / 50, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 100.4ms (= 5021.5ms / 50, input_shape=[8, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 0.96 (= 100.4ms / 104.6ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 79.5ms (= 3975.3ms / 50, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 75.4ms (= 3770.0ms / 50, input_shape=[4, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.95 (= 75.4ms / 79.5ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 80.0ms (= 3998.2ms / 50, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 72.3ms (= 3613.8ms / 50, input_shape=[2, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.90 (= 72.3ms / 80.0ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 75.3ms (= 3762.9ms / 50, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 63.1ms (= 3157.3ms / 50, input_shape=[1, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.84 (= 63.1ms / 75.3ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

OneFlow resnet50 time: 136.1ms (= 6803.0ms / 50, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 140.0ms (= 6997.7ms / 50, input_shape=[16, 3, 224, 224])
❌ Relative speed: 1.03 (= 140.0ms / 136.1ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 78.1ms (= 3903.7ms / 50, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 82.1ms (= 4106.5ms / 50, input_shape=[8, 3, 224, 224])
❌ Relative speed: 1.05 (= 82.1ms / 78.1ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 50.9ms (= 2542.7ms / 50, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 60.0ms (= 2999.8ms / 50, input_shape=[4, 3, 224, 224])
✔️ Relative speed: 1.18 (= 60.0ms / 50.9ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 43.3ms (= 2166.0ms / 50, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 45.2ms (= 2258.7ms / 50, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 1.04 (= 45.2ms / 43.3ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 46.2ms (= 2308.5ms / 50, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 42.9ms (= 2145.7ms / 50, input_shape=[1, 3, 224, 224])
✔️ Relative speed: 0.93 (= 42.9ms / 46.2ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1/usr/lib/x86_64-linux-gnu/libibverbs.so.1

OneFlow resnet50 time: 161.1ms (= 8056.2ms / 50, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 160.3ms (= 8014.7ms / 50, input_shape=[16, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.99 (= 160.3ms / 161.1ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 109.5ms (= 5473.5ms / 50, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 103.1ms (= 5155.0ms / 50, input_shape=[8, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.94 (= 103.1ms / 109.5ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 79.6ms (= 3979.7ms / 50, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 74.1ms (= 3706.6ms / 50, input_shape=[4, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.93 (= 74.1ms / 79.6ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 74.9ms (= 3743.1ms / 50, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 64.7ms (= 3234.6ms / 50, input_shape=[2, 3, 224, 224], ddp, world size=2)
❌ Relative speed: 0.86 (= 64.7ms / 74.9ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1

loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1
OneFlow resnet50 time: 75.6ms (= 3780.8ms / 50, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 68.8ms (= 3437.8ms / 50, input_shape=[1, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 0.91 (= 68.8ms / 75.6ms)
loaded library: /usr/lib/x86_64-linux-gnu/libibverbs.so.1