python binding does not use explicitly requested NVIDIA GPU

[cebtenzzre]

gpu - NVIDIA GeForce RTX 3050 Laptop GPU
model - tinyllama-1.1b-chat-v1.0.Q8_0.gguf
os - Windows 11

When I use GPT4All UI, it uses the gpu while prompting.

But when I try to prompt in my notebook, it loads the model with above gpu set as device without any error.

GPT4All("path\\to\\tinyllama-1.1b-chat-v1.0.Q8_0.gguf", device='NVIDIA GeForce RTX 3050 Laptop GPU')

But, when I prompt, it doesn't use the gpu memory, only uses cpu (in task manager). How can I run gpu?

Originally posted by @soumenseth in #1843 (comment)