equal => allclose

[jackalcooper]

No description provided.

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

OneFlow resnet50 time: 128.0ms (= 6399.8ms / 50, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 140.8ms (= 7041.2ms / 50, input_shape=[16, 3, 224, 224])
Relative speed: 1.10 (= 140.8ms / 128.0ms)

OneFlow resnet50 time: 74.3ms (= 3715.6ms / 50, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 84.6ms (= 4231.6ms / 50, input_shape=[8, 3, 224, 224])
Relative speed: 1.14 (= 84.6ms / 74.3ms)

OneFlow resnet50 time: 48.3ms (= 2417.4ms / 50, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 59.7ms (= 2983.0ms / 50, input_shape=[4, 3, 224, 224])
Relative speed: 1.23 (= 59.7ms / 48.3ms)

OneFlow resnet50 time: 43.2ms (= 2159.5ms / 50, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 46.6ms (= 2328.1ms / 50, input_shape=[2, 3, 224, 224])
Relative speed: 1.08 (= 46.6ms / 43.2ms)

OneFlow resnet50 time: 39.4ms (= 1968.0ms / 50, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 42.3ms (= 2117.3ms / 50, input_shape=[1, 3, 224, 224])
Relative speed: 1.08 (= 42.3ms / 39.4ms)

OneFlow resnet50 time: 142.7ms (= 7137.3ms / 50, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 160.4ms (= 8020.4ms / 50, input_shape=[16, 3, 224, 224], ddp, world size=2)
Relative speed: 1.12 (= 160.4ms / 142.7ms)

OneFlow resnet50 time: 93.3ms (= 4662.6ms / 50, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 103.1ms (= 5156.4ms / 50, input_shape=[8, 3, 224, 224], ddp, world size=2)
Relative speed: 1.11 (= 103.1ms / 93.3ms)

OneFlow resnet50 time: 72.6ms (= 3629.3ms / 50, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 83.3ms (= 4164.4ms / 50, input_shape=[4, 3, 224, 224], ddp, world size=2)
Relative speed: 1.15 (= 83.3ms / 72.6ms)

OneFlow resnet50 time: 67.3ms (= 3363.1ms / 50, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 62.1ms (= 3107.0ms / 50, input_shape=[2, 3, 224, 224], ddp, world size=2)
Relative speed: 0.92 (= 62.1ms / 67.3ms)

OneFlow resnet50 time: 62.0ms (= 3102.3ms / 50, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 70.9ms (= 3544.9ms / 50, input_shape=[1, 3, 224, 224], ddp, world size=2)
Relative speed: 1.14 (= 70.9ms / 62.0ms)