Running asyncio.get_event_loop().run_until_complete(query(args)) more than once deadlocks program

[gamendez98]

for

@lmql.query
async def s(output, material_text: str):
    '''
sample(temperature=0.5)
   """Write 2 one-sentence true summaries and 4 one-sentence false summaries in the style of a first-grade reading comprehension test.  Replace "I" with a third-person word. Only use information from the paragraph.
   Paragraph:
   {material_text}
   True summaries:{nl}"""
   for i in range(2):
      "- [correct_summaries]"
      output.append(correct_summaries)
   """False summaries:{nl}"""
   for i in range(4):
      "- [incorrect_summaries]"
      output.append(incorrect_summaries)
from
   "openai/text-davinci-003"
where
   STOPS_AT(correct_summaries, "{nl}") and STOPS_AT(incorrect_summaries, "{nl}")'''

if I run

l=[]
asyncio.get_event_loop().run_until_complete(s(l, "some text"))

it executes just fine, but the second time it seems to produce a deadlock

[lbeurerkellner]

I think there may be an issue with worker threads being shut down after the first completion. I will investigate a bit and report here.

For now, usually when running multiple queries in sequence, I would suggest a pattern like this:

async def main():
   l = []
   await s(l, "some text")
   await s(l, "some text")

asyncio.run(main)

[gamendez98]

Thank you for the quick answer. sadly I am calling the functions from within a RabbitMq callback that I cannot make async and since I the function gets called for each message I need a way to transition more than once from non-async to async

[lbeurerkellner]

I see. For this you may want to have a look at how we bridge async/non-async for langchain integration, see https://github.com/eth-sri/lmql/blob/main/src/lmql/runtime/langchain.py

Bascially, if possible try re-using the event loop. Still, I will see what I can do to enable your initial use.

[gamendez98]

Thanks a lot!! I am triying to see exactly where it gets locked to have a better idea on whats happening
so far it gets locked on
lmql/runtime/bopenai/batched_openai.py :675
PS I am using version 0.0.5.1

[gamendez98]

It worked thanks!!