Skip to content

Conversation

@csellis
Copy link
Contributor

@csellis csellis commented May 15, 2024

source is from https://github.com/stanfordnlp/dspy/pull/342/files

ERRORS,
max_time=15,
)
def get_embeddings(self, queries: List[str]) -> List[List[float]]:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could the caching functionality included in this PR be used here?

I realize we probably need an abstracted Retriever class to handle this but for now, feel free to check if this suffices

{
"data": {
"text/plain": [
"[upserted_count: 100,\n",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe better to remove the output for this cell :)

"name": "stdout",
"output_type": "stream",
"text": [
"Bootstrapped 0 full traces after 20 examples in round 0.\n"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it seems like the bootstrapping in this case couldn't find any valid examples. I'm curious if it is because of the retriever and what passages are being retrieved - worth investigating if it is due to the changes in this PR. We typically expect this example to work with most LMs/RMs but it could just be these 20 were not valid outputs. Just worth checking IMO before merging this example if that is the case

@arnavsinghvi11
Copy link
Collaborator

Hi @csellis , thanks for the PR! left a few comments to be addressed before merging. Also could you run ruff check . --fix-only and commit again to pass the failing test?

@arnavsinghvi11
Copy link
Collaborator

Hi @csellis , I updated the ruff fix but accidentally merged this. Could you reopen this with the updated changes as per the comments? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants