Skip to content

Conversation

@majapavlo
Copy link
Contributor

@majapavlo majapavlo commented Apr 12, 2024

Documents the latest way to address these two issues:

Please also note that the disable cache feature is not available on the latest version of the dspy package available on pypi. See: #805

@arnavsinghvi11
Copy link
Collaborator

Hi @majapavlo , does disabling the cache not work currently? Also just made a tweak to the phrasing since DSP_CACHEBOOL refers to the cache_turn_on flag.

@majapavlo
Copy link
Contributor Author

The change you added might confuse users, since as a consumer of this library the cache_turn_on variable is a hidden implementation detail.
It should be possible to disable the cache without modifying the source code of the library, i.e. by setting an environment variable. This feature has already been added to the code, and is present on the main branch via the environment variable DSP_CACHEBOOL.

However, currently disabling the cache does not work, since the latest version of the package on pypi is missing this feature as the pypi releases are out of date. See this issue: #805.

@arnavsinghvi11
Copy link
Collaborator

I see, thanks for raising the concern @majapavlo . We have updated the README to mention how to use the library locally to use cache_turn_on as well.

@arnavsinghvi11 arnavsinghvi11 merged commit 85699e6 into stanfordnlp:main Apr 15, 2024
arnavsinghvi11 added a commit that referenced this pull request Jul 12, 2024
docs(faqs): update documentation for disabling the cache
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants