Missing values warning with Adaptive Resampling #310
Comments
|
I just committed some changes that probably fix the issue. One of the numerical checks was failing so I added some extra error trapping. Please test if you can to validate the changes |
|
It seems not working, besides the previous warning, new error occured
o 84 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains
|
|
If change the Adaptive Resampling method with"method = "gls"", none new error showed. but the warning still occurs. |
|
I can't reproduce this with Plus, I don't think that this is exactly the code that you used. For example, the logging of what models are being run are not in your output such as + Fold10.Rep5: size=9, decay=0.01778, bag=FALSEnor is the # weights: 150
iter 10 value 130.246346
iter 20 value 104.789492A few other things:
Your code above works for me, but this might be better for testing: seeds <- vector(mode = "list", length = 51)
seeds <- lapply(seeds, function(x) 1:100)
Cctrl <- trainControl(method = "adaptive_cv", repeats = 5,
classProbs = TRUE,,
returnResamp = "final", verboseIter = TRUE,
summaryFunction = multiClassSummary,
seeds = seeds,
adaptive = list(min = 5,
alpha = 0.05,
method = "BT",
complete = TRUE))
set.seed(1)
mod1 <- train(Type ~ ., data = glass_train,
method = "avNNet",
preProc = c("center", "scale"),
tuneLength = 10,
trControl = Cctrl,
trace = FALSE,
maxit = 1000,
allowParallel = FALSE,
metric = "logLoss") |
|
Hi! Max,
o 74 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains
|
|
This still doesn't seem right. The error that you are seeing is what I specifically guarded against. Can you
Thanks, Max |
|
Hi! Max! ########################################
o 75 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains
locale: attached base packages: other attached packages: loaded via a namespace (and not attached):
|
|
Try running it sequentially. |
|
Hi! Max, ########################################
o 69 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains o 100 eliminated;0 remains
locale: attached base packages: other attached packages: loaded via a namespace (and not attached):
|
|
I finally figured it out. The issue is with the current version of |
|
Thank, Max! Great work, I do appreciate your help! |
|
please verify that it works and I'll close this issue (and add comments when I hear back from Heather). Thanks, Max |
|
Hi! max,
|
|
You can get it on the CRAN page (manually): https://cran.r-project.org/src/contrib/Archive/BradleyTerry2/ On Tue, Nov 10, 2015 at 10:41 AM, elephann notifications@github.com wrote:
|
|
Hi, Max, Loading required package: nnet Fold01.Rep1: size= 1, decay=0.0000000, bag=FALSE
attached base packages: other attached packages: loaded via a namespace (and not attached): warnings() |
|
The warnings are not a problem. They only occur since you have parameter On Tue, Nov 10, 2015 at 8:31 PM, elephann notifications@github.com wrote:
|
|
Hi, Max, not a problem, then I think you can close this issues now. |
|
This should work for both versions now. |
HI!Max!
I am dealing with a multiple class classification problem and constantly occur the following warning:
Warning messages:
1: In adaptiveWorkflow(x = x, y = y, wts = weights, info = trainInfo, :
There were missing values in resampled performance measures.
2: In adaptiveWorkflow(x = x, y = y, wts = weights, info = trainInfo, :
There were missing values in resampled performance measures.
Because the real data are too big to upload, so I download data from the following link:
http://archive.ics.uci.edu/ml/datasets/Glass+Identification.
And runing it the same as to my real data, the warning is the same. Is this a bug or something else?
Besides avNNet seems not working well on mac with doMC.
The text was updated successfully, but these errors were encountered: