Option to keep model(s) in memory

[CaptainVarghoss]

Feature Idea

As far as I could figure out there is currently no way to disable the automatic clearing of vram after X minutes.
In my setup the model(s) needs to be loaded and always available to avoid the loading time of the first generation.

Simply setting ClearVRAMAfterMinutes to 0 to disable the timer would make sense I think. Or some other checkbox to turn it off.

And yes, I know I could set it to some large number, but in some cases it's possible the instance could be idle long enough to surpass that anyway. Being able to disable it completely would be cleaner.

Other

No response

[mcmonkey4eva]

Just set it to 999999 or whatever. If your server goes 2 years running without generating anything I think it's okay to have the vram finally clear out at that point.

[CaptainVarghoss]

Like I said, I feel it would be a cleaner solution to be able to properly disable it.

Not to mention that currently if you set it to 0 expecting it to work that way, it just reloads the model for every single generation. While the logic behind this makes sense, it's not expected behavior.

[mcmonkey4eva]

You can now set to -1 to disable