async handling adjustments

[piotrm0]

Adjusted handling of wrapped async methods so that a record is added to the database with placeholder values and then updated once the async computation is done. Example using rag_chain of langchain_quickstart.ipynb:

with tru_recorder as recording:
    llm_response = rag_chain.ainvoke("What is Task Decomposition?")

print(recording.records[0].main_output)

Output:

NOTE from trulens_eval:
    This app produced an asynchronous response of type `coroutine`. This record will be updated once
    the response is available. If this message persists, check that you are
    using the correct version of the app method and `await` any asynchronous
    results.

But once we do:

await llm_response

The record gets updated so the same main output printout is as expected:

Task Decomposition is a technique used to break down complex tasks into smaller and simpler steps. This approach allows agents to plan and execute tasks more efficiently by dividing them into manageable components. Task decomposition can be achieved through various methods such as prompting with specific instructions or utilizing human inputs.

Presently this only works if the whole output of the wrapped function is the awaitable, it will not work if the awaitable is hidden inside the return somewhere.

Also refactored some async methods to not rely on the sync/desync utility which should reduce the number of "coroutine already awaited" errors.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB