accelerate pytorch benchmark

[grimoire]

--------------------------------------------------
concurrency: 256
elapsed_time: 295.300s

first token latency(s)(min, max, ave): 0.623, 12.899, 4.401
per-token latency(s) percentile(50, 75, 95, 99): [0, 0, 0.708, 0.979]

number of prompt tokens: 740656
number of completion tokens: 695134
token throughput (completion token): 2353.993 token/s
token throughput (prompt + completion token): 4862.142 token/s
RPS (request per second): 10.159 req/s
RPM (request per minute): 609.550 req/min
--------------------------------------------------

[AllentDan]

May update benchmark/profile_generation.py as well. I heard the two scripts will be merged into one.