New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Makes the XCode Archive time 10 times longer. #5
Comments
I have the same problem too in latest 1.0.3 . It archive time 40 minute. (Before is about 1minute)。 |
me too |
Also can use my copy packages to fix this issue. https://github.com/JerryFans/flutter_tiktoken. And is Published to flutter pub. |
This Helped me. Thanks a lot. |
@JerryFans Could you explain the root cause for increasing building time? |
In the past, there were four final map inside to match tokens usage, each with more than 100,000 lines of keys. Resulting in very slow compilation. I split the four map into dozens of small json files (In order to prevent oom), and initialized the json into the original map in the main function and can fix this issue. |
Got it. Thanks for the explanation. @JerryFans |
Thanks for suggesting a fix @JerryFans. It would be nice if you can issue a PR with the fix in this repository so that @mvitlov can release it. |
Ok, I'll submit a PR later. |
Hi, curious if the fix by Jerry would be accepted? |
Switched from the tiktoken package to langchain_tiktoken in order to resolve the extremely long build-time release-mode issue. Original issue: mvitlov/tiktoken#5 The package owner didn't merge the pull request: mvitlov/tiktoken#6 So we're using the forked and refactored langchain_tiktoken package instead: https://pub.dev/packages/langchain_tiktoken --------- Co-authored-by: David Miguel <me@davidmiguel.com>
…z#285) Switched from the tiktoken package to langchain_tiktoken in order to resolve the extremely long build-time release-mode issue. Original issue: mvitlov/tiktoken#5 The package owner didn't merge the pull request: mvitlov/tiktoken#6 So we're using the forked and refactored langchain_tiktoken package instead: https://pub.dev/packages/langchain_tiktoken --------- Co-authored-by: David Miguel <me@davidmiguel.com>
Hi, thanks for your work on this library.
I found that this library makes the XCode Archive time 60 times longer than before. Before I used this library, it took 40s to archive my application(an macOs application), but now it takes 40 minutes.
The text was updated successfully, but these errors were encountered: