Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chats save too slowly, and as of v2.7.1 load too slowly #1999

Open
SuperUserNameMan opened this issue Feb 22, 2024 · 1 comment
Open

Chats save too slowly, and as of v2.7.1 load too slowly #1999

SuperUserNameMan opened this issue Feb 22, 2024 · 1 comment
Labels
chat gpt4all-chat issues enhancement New feature or request QoL

Comments

@SuperUserNameMan
Copy link

SuperUserNameMan commented Feb 22, 2024

Bug Report

I have 25 chats saved on disk.
When I exit gpt4all, it takes several minutes because it saves every 25 chats one by one, even if these chats were not modified.

if I observe the content of the directory while gpt4all is closing, i see that each chat is slowly replaced by a .tmp file of same size.

Also, since today's fresh new update to 2.7.1, I've noticed that loading the list of chats into the left panel is very slow (one chat item every 2 to 3 seconds).

Steps to Reproduce

  1. Chat a lot for several months and several gpt4all versions with different models Just creating one or two new chat is enough though ;
  2. Open gpt4all 2.7.1 version, open the left panel to observe how slow the list of chats is loading ;
  3. Quit gpt4all 2.7.x, and observe how long it take to close ;
  4. optionally, open the directory were the files are saved and observe each .chat is slowly replaced by a .tmp ;

Expected Behavior

  • Don't save unmodified chats ;
  • Only save new and modified chats ;
  • Save them quickly ;
  • List them quickly ;

Your Environment

  • GPT4All version : 2.7.1 and some version before ;
  • Operating System: Linux Mint 21.2 ;
  • Computer : Ryzen 5 5500 U laptop, with 64 GB of RAM and nvme SSD.
@cebtenzzre cebtenzzre added enhancement New feature or request chat gpt4all-chat issues and removed bug-unconfirmed labels Feb 26, 2024
@cebtenzzre cebtenzzre changed the title 2.7.1 and previous : closing take minutes because it RE-save all chats, including unmodified Chats save too slowly, and as of v2.7.1 load too slowly Feb 26, 2024
@cebtenzzre cebtenzzre added the QoL label Feb 26, 2024
@SuperUserNameMan
Copy link
Author

[Debug] (Mon May 20 22:50:41 2024): deserializing chat "/home/WHATEVER//gpt4all-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx.chat"
...
[Debug] (Mon May 20 22:50:45 2024): deserializing chat "/home/WHATEVER//gpt4all-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx.chat"
[Debug] (Mon May 20 22:50:51 2024): deserializing chat "/home/WHATEVER//gpt4all-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx.chat"
[Debug] (Mon May 20 22:50:55 2024): deserializing chats took: 14556 ms
[Debug] (Mon May 20 22:51:09 2024): serializing chat "gpt4all-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx.chat"
[Debug] (Mon May 20 22:51:35 2024): serializing chat "gpt4all-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx.chat"
[Debug] (Mon May 20 22:52:09 2024): serializing chat "gpt4all-xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx.chat"
[Debug] (Mon May 20 22:52:24 2024): serializing chats took: 75421 ms

The 3 chats sizes are 904MB, 664MB and 327MB.
14 seconds to deserialize.
75 seconds to RE-serialize despite no change. That's a lot of rewriting that is wearing down my SSD :-(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
chat gpt4all-chat issues enhancement New feature or request QoL
Projects
None yet
Development

No branches or pull requests

2 participants