[Feature]: request metrics count #159
Description
Is your feature request related to a problem?
Need to count and display tps ttft input_tokens and output_tokens
Describe the Solution you'd like
When a request is received, count and display tps ttft input_tokens and output_tokens in logs
Alternatives Considered (Optional)
No response
Additional Context (Optional)
No response