New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

'Kkma().nouns' raises 'jpype._jexception.java.lang.OutOfMemoryErrorPyRaisable' on a weird sentence #73

Closed
krkhnh opened this Issue Aug 18, 2015 · 1 comment

Comments

Projects
None yet
2 participants
@krkhnh

krkhnh commented Aug 18, 2015

from konlpy.tag import Kkma

text = '@ninsho111 ㄴ슫ㅋㅋㄱㅋㄷㄷㄱㄱㄷㄱㅋ아진ㄴㄴ자거위님ㅁㅁ넘유쾤ㄱ핵ㅋㄱㅋㄷㄱㄱㅋㄱㅋㄱㄱㅋㅅ후..저..자야조..eㅎㅇㄱㄱ.....ㄹ오늘ㄹ은ㅁ샐라고한거아닌ㄴ데...츄우기....거위님ㅁ보니가치킨ㄴ먹ㄱ고싶어요...꿈ㅁ에서 네네치킨ㄴ먹ㄱ을래욛...(기절'

nouns = Kkma().nouns(text)

textKkma().nouns(text)식으로 수행하면 에러가 발생할 때까지 CPU와 메모리 리소스를 최대한으로 사용합니다. 그리고 몇 분 뒤에 jpype._jexception.java.lang.OutOfMemoryErrorPyRaisable에러가 발생하면서 종료됩니다.

다른 NLP는 문제가 없습니다.

@krkhnh krkhnh changed the title from 'Kkma().nouns' causes 'jpype._jexception.java.lang.OutOfMemoryErrorPyRaisable' on a weird sentence to 'Kkma().nouns' raises 'jpype._jexception.java.lang.OutOfMemoryErrorPyRaisable' on a weird sentence Aug 18, 2015

@e9t e9t added bug kkma labels Aug 27, 2015

@e9t

This comment has been minimized.

Member

e9t commented Aug 27, 2015

중요한 버그를 발견하셨네요. 올려주신 예시에는 띄어쓰기가 없는데, 꼬꼬마가 그런 긴 텍스트에 취약한 것 같습니다. 버그리포팅 감사합니다. 👍 말씀해주신 사항은 KoNLPy에서 해결할 수 없는 문제이기 때문에, 문서에 관련 내용을 추가하고, 이슈는 닫도록 하겠습니다.

@e9t e9t closed this Aug 27, 2015

e9t added a commit that referenced this issue Aug 27, 2015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment