Can't call OWU api from tool function

[DefaultUser1606]

I have a tool that generates a docx file based on user input. The tool tries to upload the created file into OWU using the /api/v1/files/ endpoint, but calling that endpoint (or any other OWU endpoint) within a tool appears to cause the entire OWU server to deadlock.

I think it might be caused by the following chain:

1. The initial chat message is processed in /api/chat/completions/ endpoint call
2. Within that call the llm decides to call the tool
3. The tool calls another endpoint while the api is busy processing the chat call. Since the api is busy, it doesn't respond creating a deadlock

If my guess is correct, how can one upload a file to OWU from within a tool correctly?

[MrMakkarone]

Hey, I also struggled with that and it really bugged me. I thought the error was on my end and AGI couldnt help me... >< Actually the Open WebUIs chatbot brought me here, so thanks for that.

My fix inside my custom tool which includes xlsx file upload and a download link creation:

 import io
 import pandas as pd
 import httpx

 async def _upload_file_to_owui(
       self,
       file_bytes: bytes,
       filename: str,
       # token: str,
       base_url: str = "http://host.docker.internal:3000",
   ) -> str:
       """Upload a file to Open WebUI and return its file ID."""
       token = "workingToken"
       url = f"{base_url}/api/v1/files/"
       headers = {
           "Authorization": f"Bearer {token}",
           "Accept": "application/json",
       }

       files = {"file": (filename, file_bytes)}

       async with httpx.AsyncClient() as client:
           response = await client.post(url, headers=headers, files=files, timeout=10)
           response.raise_for_status()
           return response.json()["id"]

   async def _generate_xlsx_tool(self, orders) -> str:
       base_download_url = "http://localhost:3000"

       df = pd.DataFrame(orders)

       # Write Excel to memory
       buffer = io.BytesIO()
       df.to_excel(buffer, index=False, engine="openpyxl")

       file_bytes = buffer.getvalue()

       # Upload
       file_id = await self._upload_file_to_owui(
           file_bytes=file_bytes,
           filename="orders.xlsx",
       )

       download_url = f"{base_download_url}/api/v1/files/{file_id}/content"

       return f"Your file is ready: [Download orders.xlsx]({download_url})"

The workaround for the deadlock is basically to use instead of, in my case request.post, a separate async thread. Herefore, the "async with httpx.AsyncClient() as client:" made the deal. Make sure to await the responses otherwise you will get a coroutine object.

Good luck^^