-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I tried to run it and ran into some problems #3
Comments
I think it has to do with file decoding which was fixed by @wannaphong in the last merge (by adding encoding = "utf-8-sig"). Can you try download the last version pip install git+git://github.com/jaidedai/jaidedread.git and try again? |
How much gpu memory is needed to run this program? Can i change bath_size because my computer only have 2 GiB |
Default batch_size is already minimum. It consumed 2.xx GiB on my computer. You can try to run on cpu mode by adding optional argument. reader = jaidedread.Reader(['en'], gpu = False) |
i try to run on cpu mode but have new problem
|
Code is not tested on Windows yet. I'll fix it in next update. |
Looking forward to the next update |
I just tried it on windows. What you need is https://stackoverflow.com/questions/24363300/freeze-support-bug-in-using-scikit-learn-in-the-anaconda-python-distro. Just wrap everything in main() and call it. for example, in your
|
It's working fine |
I recommend reading those links in 'Acknowledgement and References' Section. |
thanks |
Warning error
Traceback (most recent call last): File "C:/Users/amp/PycharmProjects/untitled3/test.py", line 2, in <module> reader = jaidedread.Reader(['th','en']) File "C:\Users\amp\PycharmProjects\untitled3\venv\lib\site-packages\jaidedread\jaidedread.py", line 87, in __init__ char_list = input_file.read().splitlines() UnicodeDecodeError: 'gbk' codec can't decode byte 0x81 in position 2: illegal multibyte sequence
I don't know what to do about it
The text was updated successfully, but these errors were encountered: