[RFE] Move system_prompt to configuration #123
Description
Is your feature request related to a problem? Please describe.
The system_prompt is currently part of the QueryRequest model.
System Prompts can be very large and serialising them in every request is expensive.
It might be nice to add support for providing a system_prompt in the ServiceConfiguration object.