bug: LocalHFBackend seems to have a memory blow up if you repeatedly call Instruct #378
{{ message }}
bug:
LocalHFBackend seems to have a memory blow up if you repeatedly call Instruct #378
The current
LocalHFBackendseems to gradually increase memory on GPU when you repeatedly call instruct, resulting in a OOM error.