Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add argument for "input" along with "instruction" #6

Open
sidharthiimc opened this issue May 30, 2023 · 2 comments
Open

Add argument for "input" along with "instruction" #6

sidharthiimc opened this issue May 30, 2023 · 2 comments

Comments

@sidharthiimc
Copy link

image

@rmihaylov
Copy link
Owner

It is either prompt or instruction. You would feed in prompt when the model in hand is not finetuned with an instruction dataset. On the other hand, you will feed in an instruction when one uses an instruction-finetuned model.

@sidharthiimc
Copy link
Author

I understand the prompt and instruction can't be passed together. Let's say I want to use one data point Alpaca dataset for inference after fine tuning. For example :

{
"instruction": "Identify the odd one out.",
"input": "Twitter, Instagram, Telegram",
"output": "Telegram"
}

How can I pass this instruction + input in the generate.py?

I need an argument for "input" here -

image

or do you have any other solution for it? How can I structure it in prompt?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants