Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: [Manual inported model not visible] #3180

Closed
2 of 4 tasks
milen-prg opened this issue Jul 21, 2024 · 6 comments
Closed
2 of 4 tasks

bug: [Manual inported model not visible] #3180

milen-prg opened this issue Jul 21, 2024 · 6 comments
Labels
type: bug Something isn't working

Comments

@milen-prg
Copy link

  • I have searched the existing issues

Current behavior

The manual imported models (folder or gguf file) are not visible in downloaded models list so are not selectable and can't be used. The are in jan data folder, but not in user interface.
After importing, the Jan creates the new folder with the gguf file and model.json for example:
{ "object": "model", "version": "1.0", "format": "gguf", "sources": [ { "url": "pivot-0.1-evil-a.Q8_0.gguf", "filename": "pivot-0.1-evil-a.Q8_0.gguf" } ], "id": "pivot-0.1-evil-a.Q8_0-1", "name": "pivot-0.1-evil-a.Q8_0-1", "created": 1721583931832, "description": "", "settings": { "ctx_len": 2048, "embedding": false, "prompt_template": "{system_message}\n### Instruction: {prompt}\n### Response:", "llama_model_path": "pivot-0.1-evil-a.Q8_0.gguf" }, "parameters": { "temperature": 0.7, "top_p": 0.95, "stream": true, "max_tokens": 2048, "stop": [ "<endofstring>" ], "frequency_penalty": 0, "presence_penalty": 0 }, "metadata": { "size": 7695875104, "author": "User", "tags": [] }, "engine": "nitro" }

Minimum reproduction step

Import gguf model file. And try to use it.

Expected behavior

The user installed models worked before several last Jan updates. But now they disappeared from the user interface and can't be select to use.

Screenshots / Logs

no

Jan version

0.5.2

In which operating systems have you tested?

  • macOS
  • Windows
  • Linux

Environment details

Windows 11 Pro 64 bit
RAM 64GB
VRAM 12GB

@milen-prg milen-prg added the type: bug Something isn't working label Jul 21, 2024
@milen-prg
Copy link
Author

The manually installed model in Jan data folder with manually written model.json file (by the old versions instructions!) must be removed from the data folder and then imported from other place to work. Or in the data folder appears two different folders with the model and the two not work.

@milen-prg
Copy link
Author

milen-prg commented Jul 23, 2024

Not, after Jan restart, the manual models again are not visible.
The problem is not solved!

@milen-prg milen-prg reopened this Jul 23, 2024
@milen-prg
Copy link
Author

The models are visible in jan-win-x64-0.4.14 version, but after update to 0.5.2, they can't be used.

@Van-QA
Copy link
Contributor

Van-QA commented Jul 24, 2024

@milen-prg can you try wiping the exte‌‌ns‌ion folder within Jan data folder, and restart Jan?

@milen-prg
Copy link
Author

@milen-prg can you try wiping the exte‌‌ns‌ion folder within Jan data folder, and restart Jan?

Yes, now it works. But the new generated (at first start it showed updating...) "extensions" is about 500MB, the old was only about 160MB.

@Van-QA
Copy link
Contributor

Van-QA commented Jul 28, 2024

please stay tuned for the new Jan x Cortex 🙏 the file size will change

@Van-QA Van-QA closed this as completed Jul 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
Archived in project
Development

No branches or pull requests

2 participants