Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support InternLM #511

Closed
vansinhu opened this issue Sep 12, 2023 · 6 comments
Closed

Support InternLM #511

vansinhu opened this issue Sep 12, 2023 · 6 comments
Labels
model request Model requests

Comments

@vansinhu
Copy link

Dear ollama developer,

Greetings! I am vansinhu, a community developer and volunteer at InternLM. InternLM is a large language model similar to llama2, and we look forward to InternLM being supported in ollama. If there are any challenges or inquiries regarding support for InternLM, please feel free to join our Discord discussion at https://discord.gg/gF9ezcmtM3.

Best regards,
vansinhu

@mchiang0610
Copy link
Member

@vansinhu I would love to support this. Will take a look through your huggingface repos. Sorry for the delay!!

@mchiang0610
Copy link
Member

Possible to ask you to quantize the models, and then upload it to ollama?

@jmorganca jmorganca added the model request Model requests label Oct 23, 2023
@jmorganca jmorganca changed the title [Feature Request] Support InternLM Deploy Support InternLM Oct 23, 2023
@jmorganca
Copy link
Member

Hi @vansinhu. We'd love to support this. Ollama currently runs llama.cpp under the hood and we'd need some help getting that in ggerganov/llama.cpp#3133. After that, this should be no problem to add

@CausalLM
Copy link

CausalLM commented Dec 1, 2023

See ggerganov/llama.cpp#4283

@BruceMacD
Copy link
Contributor

Thanks for the request, the model is now supported, and it looks like some community members have added it to Ollama:
https://ollama.com/search?q=intern&p=1

Resolving this for now, depending on the popularity we might add it to the official library namespace.

@QiuZiXian
Copy link

QiuZiXian commented Jun 24, 2024

@BruceMacD May you give me a template example?
I follow fun-tunning,get the merge model,
then follow ollama to convert to gguf
create from mainfest is ok,
but conversion is not.
replay can't stop
image
my template refer :
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
model request Model requests
Projects
None yet
Development

No branches or pull requests

6 participants