Skip to content

Commit

Permalink
langchain_openai[patch]: Invoke callback prior to yielding token (#18269
Browse files Browse the repository at this point in the history
)

## PR title
langchain_openai[patch]: Invoke callback prior to yielding token

## PR message
Description: Invoke callback prior to yielding token in _stream and
_astream methods for langchain_openai.
Issue: #16913
Dependencies: None
Twitter handle: None
  • Loading branch information
williamdevena committed Feb 29, 2024
1 parent 5ee76fc commit 0486404
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions libs/partners/openai/langchain_openai/llms/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -253,7 +253,7 @@ def _stream(
if not isinstance(stream_resp, dict):
stream_resp = stream_resp.model_dump()
chunk = _stream_response_to_generation_chunk(stream_resp)
yield chunk

if run_manager:
run_manager.on_llm_new_token(
chunk.text,
Expand All @@ -265,6 +265,7 @@ def _stream(
else None
),
)
yield chunk

async def _astream(
self,
Expand All @@ -281,7 +282,7 @@ async def _astream(
if not isinstance(stream_resp, dict):
stream_resp = stream_resp.model_dump()
chunk = _stream_response_to_generation_chunk(stream_resp)
yield chunk

if run_manager:
await run_manager.on_llm_new_token(
chunk.text,
Expand All @@ -293,6 +294,7 @@ async def _astream(
else None
),
)
yield chunk

def _generate(
self,
Expand Down

0 comments on commit 0486404

Please sign in to comment.