Skip to content

Conversation

@gaya3-zipstack
Copy link
Contributor

What

  • Support run_id / token usage for prompt runs

Why

  • To display to the user, info about the token usage

How

  • Pass in uuid alongwith promptruns

Can this PR break any existing features. If yes, please list possible items. If no, please explain why. (PS: Admins do not merge the PR without this section filled)

  • All prompt studio related flows

Database Migrations

  • A new column called run_id is added to the table prompt_tudio_output_manager_promptstudiooutput

Env Config

  • NA

Relevant Docs

Related Issues or PRs

Dependencies Versions

Notes on Testing

  • token usage is to be tracked to make sure the token usage is recorded

Screenshots

Checklist

I have read and understood the Contribution Guidelines.

@gaya3-zipstack gaya3-zipstack changed the title Feature/support run Support run_id / token usage for prompt runs May 21, 2024
@gaya3-zipstack gaya3-zipstack requested review from a team, johnyrahul and kirtimanmishrazipstack and removed request for a team May 21, 2024 16:28
Copy link
Contributor

@johnyrahul johnyrahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left few comments . Please circle back on them so that I will havebetter clarity

Copy link
Contributor

@hari-kuriakose hari-kuriakose left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gaya3-zipstack LGTM overall.

Ideally we should not expose LlamaIndex constructs at all anywhere. We could iteratively achieve this.

Copy link
Contributor

@johnyrahul johnyrahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Signed-off-by: Hari John Kuriakose <hari@zipstack.com>
@hari-kuriakose
Copy link
Contributor

@gaya3-zipstack LGTM

@hari-kuriakose hari-kuriakose merged commit 0fabae8 into main May 22, 2024
@hari-kuriakose hari-kuriakose deleted the feature/support_run_id branch May 22, 2024 15:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants