Memory usage growing (MacOS)

[mdubinko]

Thanks for this. Super fantastic.
I notice that memory usage continuously grows. It starts off around 25G -- almost the same as crawling along under 100% CPU -- but with each conversation turn memory increases & swapping ensues. I don't know if you're using the issue tracker here, but just in case I thought I'd mention it. I will look more closely tomorrow, but chances are someone has already beat me to it.

MacOS Ventura 13.4 on a M1 MacBook Pro with 32Gb. Python 3.10 and pytorch 2.1.0.dev20230526