Skip to content

Modifying LLM response output with tools #1396

@kappagamma25

Description

@kappagamma25

Question

Iis it possible to edit the response from the LLM before it is presented to user? For example, I obfuscate some of the details of an API response to ensure confidential data is not sent to the LLM (e.g. masking some username or otherwise) with a placeholder, but then would like to unmask this placeholder where it occurs in the LLM response as it is presented to the user.

Is there some decorator I can use to apply tools to the LLM output response? Or another solution?

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions