Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is this an "Example Retriever" optimisation or it can also produce prompt from scratch like "LLM as Optimizers" ? #219

Closed
gabgen opened this issue Nov 9, 2023 · 3 comments

Comments

@gabgen
Copy link

gabgen commented Nov 9, 2023

It is not clear if the teleprompter is just a way to retrieve a good example from your training dataset or it can also write a prompt from scratch , and in this case how .

@gabgen gabgen changed the title Training set mandatory for compiling ? Does teleprompter need training dataset to optimize ? Nov 9, 2023
@gabgen gabgen changed the title Does teleprompter need training dataset to optimize ? Is this an "Example Retriever" optimisation or it can also produce prompt from scratch like "LLM as Optimizers" ? Nov 9, 2023
@okhat
Copy link
Collaborator

okhat commented Nov 10, 2023

It's an example generation optimization, for a complete pipeline of steps. This is a lot richer than "LLM as Optimizers", which only optimizes a few words at the start of the prompt.

@okhat
Copy link
Collaborator

okhat commented Nov 10, 2023

Learn more in the paper linked from the README (at the top).

@okhat okhat closed this as completed Nov 10, 2023
@gabgen
Copy link
Author

gabgen commented Nov 10, 2023

It's an example generation optimization, for a complete pipeline of steps. This is a lot richer than "LLM as Optimizers", which only optimizes a few words at the start of the prompt.

@okhat thanks for the feedback. "LLM as Optimizers" can actually write a prompt from scratch ( the number of words is tunable). This is particularly useful when you have very few examples to provide, so the problem is not to retrieve a good example, but more to provide a good prompt. In this case, would DSPy provide a solution to generate a good prompt, without relying on examples to put in the prompt? I saw you have a "finetune" teleprompter , is this something similar to what I am looking for ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants