Skip to content

Real time usage and cost logging #65

@JGoutin

Description

@JGoutin

Log real usage as retrieved from Bedrock or Other AWS services. Compute and log request cost.
Optionally generate Cloudwatch metrics.

Remove current estimation mechanism, because it does not use the good tokenizer for each model.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request
No fields configured for Feature.

Projects

Status
Ready

Relationships

None yet

Development

No branches or pull requests

Issue actions