Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PromptRecord for LLMs #6

Open
thorrester opened this issue Apr 30, 2024 · 0 comments
Open

PromptRecord for LLMs #6

thorrester opened this issue Apr 30, 2024 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@thorrester
Copy link
Member

Description

Description

Given that type validation and versioning of data and model artifacts are 2 core features of opsml, it seems logical to extend FileRecord to support PromptRecord and allow DataCards to accept PromptRecord as a input. This will allow users who are developing prompts for LLMs to do type validation and versioning of their prompts.

Moreover, we should consider making a host of prompt types in addition to a subclassable base.

Example Prompt Types:

  • TextClassification
  • NamedEntityRecognition
  • Translation
  • TextSummarization
  • QuestionAnswering
  • Reasoning

Potential class capabilities:

  • inject named arguments into text
  • support for validations (prevention of adversarial attacks?)
  • support formatted text to json
@thorrester thorrester added the enhancement New feature or request label Apr 30, 2024
@thorrester thorrester added the help wanted Extra attention is needed label Jul 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant