re-arch: Initial BudgetManager impl

[richbeales]

Background

Provides an initial basic implementation of the Budget / Constraint Manager for the re-architecture project. No-one had picked this up so I've given a draft. To be discussed/finessed before merging.

Changes

Flesh out the stub for BudgetManager.

Documentation

Not yet.

Test Plan

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
docs	⬜️ Ignored (Inspect)			May 7, 2023 7:01pm

[Boostrix]

FWIW, the generated prompt itself would probably also qualify as falling under "constraints", not in the financial/API sense, but in the token/chunking sense - and one that is different for people depending on the level of GPT access they've got ?

If the LLM were to be informed about the estimated costs of certain actions/commands, this could be internally used to benchmark/adapt as needed, i.e. favor actions/commands with less costs involved.

Here's a more detailed description of the idea:

• Allow multiple commands at once #3945

[github-actions]

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

[github-actions]

Conflicts have been resolved! 🎉 A maintainer will review the pull request shortly.