-
Notifications
You must be signed in to change notification settings - Fork 525
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tiktoken 0.7.0 read-only system error in AWS Lamda #909
Comments
I tried using the env variable |
We need the new Tiktoken for GPT-4o model, so this new requirement will stay. You can always use a previous release of PR-Agent without the new Tiktoken, but this seems to be a problem of AWS lambda that should be solved, one way or another. If you do find a workaround, share and we will add it to the docs. |
I did some debugging trying to find a workaround and the only one I found was setting This issue is clearly related to this other issue in litellm: BerriAI/litellm#2607. I'll also report it in that issue to see if there is any fix coming. Until this is fixed I guess AWS Lamda users will not be able to use the latest |
Any update to this? I'm running into the same issue here. full stacktrace and implementation for details:
|
@mrT23 BerriAI/litellm#2607 (comment)
https://github.com/Codium-ai/pr-agent/blob/v0.22/requirements.txt#L12
|
@mrT23 This was marked as fixed but I don't see a commit changing |
We deployed a new docker. You can retry using this suggestion: |
Using latest version from main with model
gpt-4o
throws the following error when running on AWS Lamda:Stack trace
requirements.txt
The text was updated successfully, but these errors were encountered: