Improve support for sync/async & streaming/non-streaming

[KennyVaneetvelde]

Right now we can use the .run() method in BaseAgent for normal responses, and .run_async() for streaming responses.

It would be even better to support all 4 possible configurations and have:

• .run()
• .run_async()
• .run_streaming()
• .run_streaming_async()
  (Exact naming scheme to be decided)

[jonchun]

I agree - I think the way it's currently setup was a little against convention and may have tripped me up.

run_async to me means it is the same as run() but done in an async manner. e.g.

run() -> OutputT
run_async() -> Coroutine[None, None, OutputT]

[KennyVaneetvelde]

Yes exactly, my implementation was creating some false expectations so no worries!

[OnlyC]

Hi, when will new run_async available?

[KennyVaneetvelde]

Closing this as a duplicate of #100 due to the fact that it is better worded.