Add CudaStreamIndexGenerator::GenerateNamedStreamIndex

[liujuncheng]

No description provided.

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

PyTorch resnet50 time: 140.0ms (= 6998.0ms / 50, input_shape=[16, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 128.4ms (= 6418.3ms / 50, input_shape=[16, 3, 224, 224], backward is enabled)
Relative speed: 1.09 (= 140.0ms / 128.4ms)

PyTorch resnet50 time: 85.5ms (= 4274.4ms / 50, input_shape=[8, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 74.6ms (= 3728.1ms / 50, input_shape=[8, 3, 224, 224], backward is enabled)
Relative speed: 1.15 (= 85.5ms / 74.6ms)

PyTorch resnet50 time: 61.2ms (= 3058.6ms / 50, input_shape=[4, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 47.2ms (= 2360.2ms / 50, input_shape=[4, 3, 224, 224], backward is enabled)
Relative speed: 1.30 (= 61.2ms / 47.2ms)

PyTorch resnet50 time: 49.9ms (= 2493.8ms / 50, input_shape=[2, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 42.4ms (= 2119.7ms / 50, input_shape=[2, 3, 224, 224], backward is enabled)
Relative speed: 1.18 (= 49.9ms / 42.4ms)

PyTorch resnet50 time: 41.6ms (= 2081.3ms / 50, input_shape=[1, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 39.7ms (= 1983.1ms / 50, input_shape=[1, 3, 224, 224], backward is enabled)
Relative speed: 1.05 (= 41.6ms / 39.7ms)

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

PyTorch resnet50 time: 137.2ms (= 6861.3ms / 50, input_shape=[16, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 125.5ms (= 6273.3ms / 50, input_shape=[16, 3, 224, 224], backward is enabled)
Relative speed: 1.09 (= 137.2ms / 125.5ms)

PyTorch resnet50 time: 81.1ms (= 4055.4ms / 50, input_shape=[8, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 72.7ms (= 3636.4ms / 50, input_shape=[8, 3, 224, 224], backward is enabled)
Relative speed: 1.12 (= 81.1ms / 72.7ms)

PyTorch resnet50 time: 57.8ms (= 2891.7ms / 50, input_shape=[4, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 45.7ms (= 2286.5ms / 50, input_shape=[4, 3, 224, 224], backward is enabled)
Relative speed: 1.26 (= 57.8ms / 45.7ms)

PyTorch resnet50 time: 55.3ms (= 2762.6ms / 50, input_shape=[2, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 36.3ms (= 1816.0ms / 50, input_shape=[2, 3, 224, 224], backward is enabled)
Relative speed: 1.52 (= 55.3ms / 36.3ms)

PyTorch resnet50 time: 43.5ms (= 2173.4ms / 50, input_shape=[1, 3, 224, 224], backward is enabled)
OneFlow resnet50 time: 35.4ms (= 1767.8ms / 50, input_shape=[1, 3, 224, 224], backward is enabled)
Relative speed: 1.23 (= 43.5ms / 35.4ms)