Support Async Pipes

[oloflarsson]

I'd like to add support for async def pipes(self) -> List[dict]: where the initial async is not supported today.

The use case is getting access to the await keyword within the pipes logic when writing a plugin/function.

It seems to me a small code change in functions.py could accomplish this.

Before:

# Check if pipes is a function or a list

try:
    if callable(function_module.pipes):
        sub_pipes = function_module.pipes()
    else:
        sub_pipes = function_module.pipes
except Exception as e:
    log.exception(e)
    sub_pipes = []

After:

# Handle pipes being a list, sync function, or async function
try:
    if callable(function_module.pipes):
        if asyncio.iscoroutinefunction(function_module.pipes):
            sub_pipes = await function_module.pipes()
        else:
            sub_pipes = function_module.pipes()
    else:
        sub_pipes = function_module.pipes
except Exception as e:
    log.exception(e)
    sub_pipes = []

[tjbck]

PR Welcome!

[oloflarsson]

❤️ Thank you, I have now opened a merge request: #10566

[oloflarsson]

😉🤖 Looks like o3 Mini High approves:

And yes, the function we call from is indeed marked async.

[oloflarsson]

Thanks, pull request was accepted #10566 so closing this discussion.

[savvaki]

@oloflarsson Did this perhaps break inlet calling? Because with an async inlet and an async pipe the inlet is not being called (i.e. the function calls pipe(...) without the inlet). As seen in this issue: open-webui/pipelines#415