Repository navigation
RFC: Identify the calling client in log entries #3671
T3th
started this conversation in
Request for Comment (RFC)
Replies: 2 comments
|
Sounds great to me, thanks for doing this @T3th |
0 replies
|
I like the idea, but I would wonder if this turns into too sensitive of information to be included in the logs by default. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Proposal size
Minor feature (a single PR)
Updates
No response
User story
As a Lemonade user of over a year now I have connected various GUI, CLI and self hosted services to my lemoande instances to utilise inference via the ollama and OpenAI compatible APIs provided. I have now forgotten some of the things I set up to use lemonade inference and find that my currently used models get evicted and replaced occasionally with older models because a client has requested them. I would like to be able to identify clients requesting inference from the logs so that I can correct their config or decommission them if they are just wasting inference.
High-level design
High-level design
Breaking changes
None expected for the project. New log lines and fields could break anything parsing them.
Maintenance plan
Probably covered by CI. A test server sends a request with a known User-Agent and checks that the log line is correctly produced.
Risks
Client IPs and user-agents could be considered sensitive to some. Maybe offer a config option to turn it off.
All reactions