Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shuffle input cursor reader failed with an exception in ml.net 1.4.0 #4819

Open
Spocher opened this issue Feb 8, 2020 · 1 comment
Open

Shuffle input cursor reader failed with an exception in ml.net 1.4.0 #4819

Spocher opened this issue Feb 8, 2020 · 1 comment
Labels

Comments

@Spocher
Copy link

@Spocher Spocher commented Feb 8, 2020

  • Windows 10 x64
  • NET Framework 4.7.2, ML.Net 1.4.0

I create project for multiclass classification, some code:
`var trainingDataView = mlContext.Data.LoadFromEnumerable(allTrainData);

var trainingPipeline = mlContext.Transforms.Conversion.MapValueToKey(inputColumnName: "IdCategory", outputColumnName: "Label")
.Append(mlContext.Transforms.Text.FeaturizeText(inputColumnName: "HeaderProduct", outputColumnName: "HeaderProductFeaturized"))
.Append(mlContext.Transforms.Text.FeaturizeText(inputColumnName: "DescriptionProduct", outputColumnName: "DescriptionProductFeaturized"))
.Append(mlContext.Transforms.Concatenate("Features", "HeaderProductFeaturized", "DescriptionProductFeaturized"))
.Append(mlContext.MulticlassClassification.Trainers.SdcaMaximumEntropy())
.Append(mlContext.Transforms.Conversion.MapKeyToValue("PredictedLabel"));

var trainedModel = trainingPipeline.Fit(trainingDataView);`

I try train model and have Exception:
Shuffle input cursor reader failed with an exception, ( in Microsoft.ML.Transforms.RowShufflingTransformer.Cursor.MoveNextCore()
in Microsoft.ML.Data.RootCursorBase.MoveNext()
in Microsoft.ML.Trainers.TrainingCursorBase.MoveNext()
in Microsoft.ML.Trainers.SdcaTrainerBase3.TrainCore(IChannel ch, RoleMappedData data, LinearModelParameters predictor, Int32 weightSetCount) in Microsoft.ML.Trainers.StochasticTrainerBase2.TrainModelCore(TrainContext context)
in Microsoft.ML.Trainers.TrainerEstimatorBase2.TrainTransformer(IDataView trainSet, IDataView validationSet, IPredictor initPredictor) in Microsoft.ML.Data.EstimatorChain1.Fit(IDataView input)

I downgraded the version ml.net to 1.3.1 an all worked fine.
a little later, I upgraded the version to 1.5.0-preview and all worked fine.

@frank-dong-ms

This comment has been minimized.

Copy link
Member

@frank-dong-ms frank-dong-ms commented Feb 10, 2020

Can you please provide a repro project and input data so we can look further?

I have also checked the release notes, seems nothing relate to this issue I can find.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.