Skip to content

Commit

Permalink
langchain_openai[patch]: Invoke callback prior to yielding token (lan…
Browse files Browse the repository at this point in the history
…gchain-ai#18269)

## PR title
langchain_openai[patch]: Invoke callback prior to yielding token

## PR message
Description: Invoke callback prior to yielding token in _stream and
_astream methods for langchain_openai.
Issue: langchain-ai#16913
Dependencies: None
Twitter handle: None
  • Loading branch information
williamdevena authored and gkorland committed Mar 30, 2024
1 parent 36782f2 commit d053b6f
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions libs/partners/openai/langchain_openai/llms/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -253,7 +253,7 @@ def _stream(
if not isinstance(stream_resp, dict):
stream_resp = stream_resp.model_dump()
chunk = _stream_response_to_generation_chunk(stream_resp)
yield chunk

if run_manager:
run_manager.on_llm_new_token(
chunk.text,
Expand All @@ -265,6 +265,7 @@ def _stream(
else None
),
)
yield chunk

async def _astream(
self,
Expand All @@ -281,7 +282,7 @@ async def _astream(
if not isinstance(stream_resp, dict):
stream_resp = stream_resp.model_dump()
chunk = _stream_response_to_generation_chunk(stream_resp)
yield chunk

if run_manager:
await run_manager.on_llm_new_token(
chunk.text,
Expand All @@ -293,6 +294,7 @@ async def _astream(
else None
),
)
yield chunk

def _generate(
self,
Expand Down

0 comments on commit d053b6f

Please sign in to comment.