Python: New Feature: build service with Local open source LLM

[AlphaDragon009]

---

name:build service with Local LLM
about: This might a question rather than a suggestion.

I am using open source LLM (for example , Phi-4,)
for example

from llama_cpp import Llama
llm= Llama(model_path=model_path, n_ctx=2048)

and use this llm to able to called by add_service.

kernel = Kernel()
kernel.add_service( serviceid )

Can you help me or provide an example to complete the function to use open source LLM rather than API or other API?
Thanks

---

[markwallace-microsoft]

@AlphaDragon009 please take a look at the local model samples here: https://github.com/microsoft/semantic-kernel/tree/main/python/samples/concepts/local_models