Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

加载模型出错 #26

Closed
yudian931122 opened this issue Jul 21, 2020 · 6 comments
Closed

加载模型出错 #26

yudian931122 opened this issue Jul 21, 2020 · 6 comments

Comments

@yudian931122
Copy link

加载模型时,出现如下错误:
Exception in thread "main" java.lang.IllegalArgumentException: Unknown EntryType enum second :136
at com.mayabot.nlp.fasttext.dictionary.EntryType$Companion.fromValue(DictUtils.kt:57)
at com.mayabot.nlp.fasttext.dictionary.Dictionary$Companion.loadModel(Dictionary.kt:384)
at com.mayabot.nlp.fasttext.FastText$Companion.loadModel(FastText.kt:711)
at cn.com.duiba.spark.dmp.api.FasttextTest.loadModel(FasttextTest.java:61)
at cn.com.duiba.spark.dmp.api.FasttextTest.main(FasttextTest.java:43)

求解

@jimichan
Copy link
Member

jimichan commented Jul 21, 2020 via email

@yudian931122
Copy link
Author

也是通过这个java版本训练出来的
刚才又训练一个数据量小一点,加载没问题
这是为啥呀

@yudian931122
Copy link
Author

有办法吗?大佬 @jimichan

@jimichan
Copy link
Member

数据能不能发来我测试一下,把你的训练参数代码也给我看一下.

105287540@qq.com

@yudian931122
Copy link
Author

数据能不能发来我测试一下,把你的训练参数代码也给我看一下.

105287540@qq.com

数据不太方便给,见谅哈
目前猜测可能是某些特殊字符导致的这个问题,我用'[^\\u4E00-\\u9FFF]'正则去掉所有字符后,再训练模型是可以加载的
参数:
InputArgs inputArgs = new InputArgs();
inputArgs.setLoss(LossName.softmax);
inputArgs.setLr(1D);
inputArgs.setDim(100);
inputArgs.setWordNgrams(3);
inputArgs.setEpoch(25);

@jimichan
Copy link
Member

能解决就好

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants