ChicagoCrimeApp example not working

[exalate-issue-sync]

{code:python}21/12/31 20:32:34 WARN TaskSetManager: Lost task 1.0 in stage 449.0 (TID 7758, 172.17.0.2, executor 1): org.apache.spark.SparkException: Failed to execute user defined function($anonfun$2: (struct<PERCENT_OF_HOUSING_CROWDED:double,PERCENT_HOUSEHOLDS_BELOW_POVERTY:double,PERCENT_AGED_16__UNEMPLOYED:double,PERCENT_AGED_25__WITHOUT_HIGH_SCHOOL_DIPLOMA:double,PERCENT_AGED_UNDER_18_OR_OVER_64:double,PER_CAPITA_INCOME:int,HARDSHIP_INDEX:int,IUCR:smallint,Primary_Type:string,Location_Description:string,Domestic:double,Beat:smallint,District:tinyint,Ward:tinyint,Community_Area:tinyint,FBI_Code:tinyint,Month:int,Day:int,WeekNum:int,HourOfDay:int,WeekDay:int,Weekend:int>, double) => struct<label:string,probabilities:struct<0:double,1:double>>)
at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown Source)
at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:395)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$2.apply(SparkPlan.scala:234)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$2.apply(SparkPlan.scala:228)
at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$25.apply(RDD.scala:835)
at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$25.apply(RDD.scala:835)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:49)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:109)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:344)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: hex.genmodel.easy.exception.PredictUnknownCategoricalLevelException: Unknown categorical level (Domestic,0.0)
at hex.genmodel.easy.RowToRawDataConverter.convertValue(RowToRawDataConverter.java:97)
at hex.genmodel.easy.RowToRawDataConverter.convert(RowToRawDataConverter.java:55)
at hex.genmodel.easy.EasyPredictModelWrapper.fillRawData(EasyPredictModelWrapper.java:1022)
at hex.genmodel.easy.EasyPredictModelWrapper.predict(EasyPredictModelWrapper.java:1027)
at hex.genmodel.easy.EasyPredictModelWrapper.preamble(EasyPredictModelWrapper.java:1018)
at hex.genmodel.easy.EasyPredictModelWrapper.predictBinomial(EasyPredictModelWrapper.java:647)
at ai.h2o.sparkling.ml.models.H2OMOJOPredictionBinomial$$anonfun$2.apply(H2OMOJOPredictionBinomial.scala:45)
at ai.h2o.sparkling.ml.models.H2OMOJOPredictionBinomial$$anonfun$2.apply(H2OMOJOPredictionBinomial.scala:42)
... 16 more
{code}

The used file seems no longer available publically

[DinukaH2O]

JIRA Issue Migration Info

Jira Issue: SW-2673
Assignee: krasinski
Reporter: krasinski
State: Resolved
Fix Version: 3.36.0.1-1
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#2707
#2708

[hasithjp]

JIRA Issue Migration Info Cont'd

Jira Issue Created Date: 2022-01-02T02:32:26.213-0800