Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[catboost4j-spark] The earlyStoppingRounds parameter is not recognized #1649

Closed
candalfigomoro opened this issue Apr 14, 2021 · 2 comments
Closed
Assignees

Comments

@candalfigomoro
Copy link

Problem:
With PySpark, when I set the earlyStoppingRounds parameter (e.g. earlyStoppingRounds=10), I get the following error:

py4j.protocol.Py4JJavaError: An error occurred while calling o318.fit.
: ai.catboost.CatBoostError: catboost/private/libs/options/plain_options_helper.cpp:495: Unknown option {early_stopping_rounds} with value "10"
	at ru.yandex.catboost.spark.catboost4j_spark.core.src.native_impl.native_implJNI.GetOneHotMaxSize(Native Method)
	at ru.yandex.catboost.spark.catboost4j_spark.core.src.native_impl.native_impl.GetOneHotMaxSize(native_impl.java:181)
	at ai.catboost.spark.CatBoostPredictorTrait.addEstimatedCtrFeatures(CatBoostPredictor.scala:55)
	at ai.catboost.spark.CatBoostPredictorTrait.addEstimatedCtrFeatures$(CatBoostPredictor.scala:43)
	at ai.catboost.spark.CatBoostClassifier.addEstimatedCtrFeatures(CatBoostClassifier.scala:362)
	at ai.catboost.spark.CatBoostClassifier.preprocessBeforeTraining(CatBoostClassifier.scala:400)
	at ai.catboost.spark.CatBoostPredictorTrait.fit(CatBoostPredictor.scala:152)
	at ai.catboost.spark.CatBoostPredictorTrait.fit$(CatBoostPredictor.scala:109)
	at ai.catboost.spark.CatBoostClassifier.fit(CatBoostClassifier.scala:362)

catboost version: catboost-spark_2.4_2.12-0.25

@andrey-khropov

@willvith
Copy link

willvith commented Apr 21, 2021

@andrey-khropov I have encountered the same issue that earlyStoppingRounds is not recognized in Spark Scala.

User class threw exception: ai.catboost.CatBoostError: catboost/private/libs/options/plain_options_helper.cpp:495: Unknown option {early_stopping_rounds} with value "100" at ru.yandex.catboost.spark.catboost4j_spark.core.src.native_impl.native_implJNI.GetOneHotMaxSize(Native Method) at ru.yandex.catboost.spark.catboost4j_spark.core.src.native_impl.native_impl.GetOneHotMaxSize(native_impl.java:181) at ai.catboost.spark.CatBoostPredictorTrait.addEstimatedCtrFeatures(CatBoostPredictor.scala:55) at ai.catboost.spark.CatBoostPredictorTrait.addEstimatedCtrFeatures$(CatBoostPredictor.scala:43) at ai.catboost.spark.CatBoostRegressor.addEstimatedCtrFeatures(CatBoostRegressor.scala:222) at ai.catboost.spark.CatBoostPredictorTrait.preprocessBeforeTraining(CatBoostPredictor.scala:81) at ai.catboost.spark.CatBoostPredictorTrait.preprocessBeforeTraining$(CatBoostPredictor.scala:75) at ai.catboost.spark.CatBoostRegressor.preprocessBeforeTraining(CatBoostRegressor.scala:222) at ai.catboost.spark.CatBoostPredictorTrait.fit(CatBoostPredictor.scala:152) at ...

catboost_version: catboost-spark_3.0_2.12-0.25

arcadia-devtools pushed a commit that referenced this issue May 21, 2021
ref:3c229bebc91ce247e268640475da3e3de932e9e1
@andrey-khropov
Copy link
Member

Released in 0.26.

robot-piglet pushed a commit that referenced this issue Jan 15, 2023
ref:3c229bebc91ce247e268640475da3e3de932e9e1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants