Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chatting and prompt #10

Open
kazunaritakeichi opened this issue Jan 17, 2024 · 0 comments
Open

Chatting and prompt #10

kazunaritakeichi opened this issue Jan 17, 2024 · 0 comments

Comments

@kazunaritakeichi
Copy link

kazunaritakeichi commented Jan 17, 2024

Can we use japanese-stablelm-3b-4e1t-instruct for chatting?

If yes, how can we do it?
Do we need add stop string like <|endoftext|> as follows?
Where do we put it?

以下は、タスクを説明する指示と、文脈のある入力の組み合わせです。要求を適切に満たす応答を書きなさい。

### 指示: 
与えられたことわざの意味を小学生でも分かるように教えてください。

### 入力: 
情けは人のためならず

### 応答: 
人に情けをかけた人の人生は、意図せずとも人に幸せをもたらすのである。<|endoftext|>

### 入力: 
もう少し詳しく教えてください

### 応答: 

This issue is duprication of https://huggingface.co/stabilityai/japanese-stablelm-3b-4e1t-instruct/discussions/1 and Stability-AI/StableLM#103.

polm-stability pushed a commit to polm-stability/FastChat that referenced this issue Mar 1, 2024
change 'torch.as_tensor(input_ids).cuda()' to kwargs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant