Skip to content

Conversation

@harini-venkataraman
Copy link
Contributor

@harini-venkataraman harini-venkataraman commented Oct 14, 2024

What

PR to support adapter for LLMWhispererv2 version
...

Why

LLMWhisperer has some major changes which has new params introduced and removal of async mode of execution.
This new adapter supports this breaking change
...

How

Addition of new adapter.
...

Relevant Docs

https://github.com/Zipstack/llmwhisperer-docs/blob/v2-docs/docs/llm_whisperer/apis/whisper.md
...

Related Issues or PRs

Not applicable
...

Dependencies Versions / Env Variables

| ADAPTER_LLMW_POLL_INTERVAL | Time in seconds to wait before polling LLMWhisperer's status API. Defaults to 30s |
| ADAPTER_LLMW_MAX_POLLS | Total number of times to poll the status API. Defaults to 30 |

...

Notes on Testing

  1. Add new X2Text adapter selecting LLMWhispererv2
  2. Use it in profile manager of prompt service and try extractions.
    ...

Screenshots

Screenshot from 2024-10-16 20-27-25

image

...

Checklist

I have read and understood the Contribution Guidelines.

Copy link
Contributor

@chandrasekharan-zipstack chandrasekharan-zipstack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some minor comments. Please bump the SDK version as well.

Copy link
Contributor

@johnyrahul johnyrahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes LGTM, Few minor comments.

Copy link
Contributor

@gaya3-zipstack gaya3-zipstack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added one minor suggestion
@Harini
Other than that, looks in-line to me.

@CLAassistant
Copy link

CLAassistant commented Oct 17, 2024

CLA assistant check
All committers have signed the CLA.

@hari-kuriakose hari-kuriakose merged commit df73510 into main Oct 17, 2024
1 check passed
@hari-kuriakose hari-kuriakose deleted the feat/llmwhisperer-v2 branch October 17, 2024 11:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants