Output format returned by postprob(lcModelKML, ...) was not valid

[Pubuditha]

Hi there,

I recently learned about the latrend package and started using it for clustering a big longitudinal data set.
I followed the steps to download the packages and also run the example code with the data set that comes in the package. Everything works well for that data set. However, when I perform the clustering for my own dataset, kml fitting works fine without any errors but 50 warnings as below (line below is repeated for 50 times with either Inf or -Inf at the end):

In FUN(newX[, i], ...) : no non-missing arguments to min; returning Inf

Not sure what this means. So no idea how I can correct this.

Then when I do "summary(model)" it gives me the following error:

Error in postprob(object, ...) :
lcModelKML implementation error: Output format returned by postprob(lcModelKML, ...) was not valid: nrow(pp) not equal to nIds(object)

I'm assuming the error is caused by the warnings I get but I'm very new to using this package and not sure how to correct this.
If someone can help me with this that will be great!

Thank you in advance!

[niekdt]

Hello,

Thanks for the detailed write-up. Are you using latrend version 1.3?

I'm unable to find where the warnings might be coming from in the package code, could you set options(warn = 2) and rerun the code? The warning will become an error, and then I'd like to see the output from traceback().

The error in postprob() is a consequence of the internal KmL model being different from what latrend is expecting. I've added strict checks to the lcModel functions such as postprob() to prevent (silent) faulty output.

Most likely, the trigger for the issue you are experiencing is that your dataset contains missing values. I've improved the robustness of latrend to missing data based on previous reports this year, but it would seem you may have found another special case that needs fixing.

[Pubuditha]

Thank you for the quick reply @niekdt

Yes I am using latrend version 1.3

I set options(warn = 2) and rerun the code. Then get the error below with summary(model):

Error: nrow(pred) not equal to .ndobs(model)

Output of traceback() is as below:

17: stop(assertError(attr(res, "msg")))
16: assert_that(is.numeric(pred), ncol(pred) == nClusters(model),
nrow(pred) == .ndobs(model), has_colnames(pred), is_valid_cluster_name(colnames(pred),
model = model), all(clusterNames(model) %in% colnames(pred)))
15: withCallingHandlers(expr, warning = function(w) if (inherits(w,
classes)) tryInvokeRestart("muffleWarning"))
14: suppressWarnings(assert_that(is.numeric(pred), ncol(pred) ==
nClusters(model), nrow(pred) == .ndobs(model), has_colnames(pred),
is_valid_cluster_name(colnames(pred), model = model), all(clusterNames(model) %in%
colnames(pred))))
13: transformFitted(newpred, model, clusters)
12: transformFitted(newpred, model, clusters)
11: transformFitted(., model = object, clusters = clusters)
10: transformFitted(., model = object, clusters = clusters)
9: predict(object, newdata = newdata) %>% transformFitted(model = object,
clusters = clusters)
8: fitted.lcApproxModel(object, clusters = clusters, ...)
7: fitted(object, clusters = clusters, ...)
6: residuals.lcModel(object)
5: residuals(object)
4: withCallingHandlers(expr, warning = function(w) if (inherits(w,
classes)) tryInvokeRestart("muffleWarning"))
3: suppressWarnings({
res = residuals(object)
if (length(res) == 0) {
res = as.numeric(NA)
}
props = tryCatch(clusterProportions(object), error = function(...) rep(NaN,
nClusters(object)))
ss = new("lcSummary", method = getLcMethod(object), name = getName(object),
nClusters = nClusters(object), nObs = ifelse(is.null(nobs(object)),
0L, nobs(object)), id = idVariable(object), coefficients = coef(object),
residuals = res, clusterNames = clusterNames(object),
trajectoryAssignments = trajectoryAssignments(object),
clusterSizes = clusterSizes(object), clusterProportions = props)
})
2: summary.lcModel(model_test2)
1: summary(model_test2)

I also thought the problem is that my data set contains missing values. So I checked the data set multiple times and removed the rows with missing values before calling it in the code and I'm 100% sure there are no missing values in the data set.

One question though, let's say I have longitudinal data for 10 students. Do I have to have the same number of timepoints for every student? If that's a requirement for this method, then that's the issue. For an example, I have students who has data for 5 years (5 timepoints) and some who might have data for 10 years or 3 years, so they don't have the same number of repeated measures.

[niekdt]

In your original post you mentioned 50 warnings during fitting. Could you rerun that with options(warn = 2) as well? Thanks

KmL indeed requires trajectories to be time-aligned and of equal length. The KmL package provides some imputation options for absent trajectory observations, but it could be that the package is removing some nearly-empty trajectories during fitting, resulting in a mismatch with what the latrend package is expecting. I will look into how to detect this, because ideally latrend should be able to handle whatever the kml package spits out.

Regarding your analysis:
If there's censoring or time-to-event is of interest, I would recommend looking into joint modeling using, for example, the lcmm package (see the Jointlcmm function). This is outside of the scope of the latrend package, for now.

Otherwise, I recommend group-based trajectory modeling (GBTM). It's probably anyway the preferred starting point for exploratory purposes, in this context. It can be regarded as a parametric version of KmL, with similar results under the condition that the cluster trajectory formulas can describe the trends properly. This method is supported by the latrend package, see lcMethodLcmmGBTM, which uses the lcmm package.

If you just want to know how students progress during their study, regardless of total study years, you could consider normalizing the time variable, such that all students start at 0 and end at 1. Whether that makes any sense at all completely depends on your data assumptions and aims. You can then use GBTM to cluster the data.

[niekdt]

I was able to reproduce the errors you were getting when using lcModelKML. These are now fixed (see #111) in the latest commit on master.

[Pubuditha]

When I rerun that with the options(warn=2), I get the following:

---

• Longitudinal clustering using: longitudinal k-means (KML)

---

Method arguments:
time: getOption("latrend.time")
id: getOption("latrend.id")
nClusters: 4
nbRedrawing: 20
maxIt: 200
imputationMethod:"copyMean"
distanceName: "euclidean"
power: 2
distance: function() {}
centerMethod: meanNA
startingCond: "nearlyAll"
nbCriterion: 1000
scale: TRUE
response: "STSDMT"

Checking and transforming the training data format.
Preparing the training data for fitting...
Error in matrix(dt[[response]], byrow = TRUE, nrow = length(ids), ncol = length(times)) :
(converted from warning) data length [112000] is not a sub-multiple or multiple of the number of rows [489]

For this, I have used a subgroup of data where I have 3 timepoints for each student. But the time points do not align for the whole data set. For some students the gap between the two time points are 2 years and for some it's 5 years (for an example). After reading your reply, I think this could be the issue for the errors I am getting. I will try the methods that you have suggested. In the mean time, if you find a fix for the problem please do let me know.
I can't normalise the time.

Thank you!

[Pubuditha]

Sorry @niekdt there was some error and my reply had not been posted for some reason. Thank you for the fix. I'll see whether it's working without a problem now.

Thank you for suggesting few other methods. I've being testing GTBM with my data.

[Pubuditha]

Hi @niekdt, I just updated the latrend installation and rerun the code. But still getting the same error msgs as before. See below:

---

      - Longitudinal clustering using: longitudinal k-means (KML)
      -----------------------------------------------------------------
      Method arguments:
       time:           getOption("latrend.time")
       id:             getOption("latrend.id")
       nClusters:      4
       nbRedrawing:    20
       maxIt:          200
       imputationMethod:"copyMean"
       distanceName:   "euclidean"
       power:          2
       distance:       function() {}
       centerMethod:   meanNA
       startingCond:   "nearlyAll"
       nbCriterion:    1000
       scale:          TRUE
       response:       "STSDMT"
      -----------------------------------------------------------------
      Checking and transforming the training data format.
      Preparing the training data for fitting...
      Fitting the method...

~ Fast KmL ~
********************S
Done fitting the method (7 secs)
-----------------------------------------------------------------
There were 50 or more warnings (use warnings() to see the first 50)

summary(model_test2)
Error in postprob(object, ...) :
lcModelKML implementation error: Output format returned by postprob(lcModelKML, ...) was not valid: nrow(pp) not equal to nIds(object)

Not sure whether I did the update correctly to reflect your fixes to the issue. What I did was this:

wnloading GitHub repo philips-software/latrend@v1.4.0
These packages have more recent versions available.
It is recommended to update all of them.
Which would you like to update?

1: All
2: CRAN packages only
3: None
4: tinytex (0.39 -> 0.40) [CRAN]

Enter one or more numbers, or an empty line to skip updates: 1

Your help is much appreciated.

[niekdt]

Thanks for the update. The other packages do not need to be updated, as the attempted fix is with the latrend package. Did you restart the R session after updating?

Unfortunately, I'm unable to reproduce the error. It does suggest that there is another data scenario for which the kml package is excluding one or more trajectories, resulting in the latrend error you are seeing. In order to better understand the source of this error, I've added an additional check today in fbb06eb. Could you install the latest commit of latrend via remotes::install_github('philips-software/latrend'), restart R, and rerun your code? You should be getting a different error this time.

I appreciate your help!

[Pubuditha]

Hi @niekdt,

I did install the latest commit and rerun the code. This time still got the 50 warnings but no errors.

~ Fast KmL ~
********************S
Done fitting the method (6.4 secs)

There were 50 or more warnings (use warnings() to see the first 50)

Then when I check the summary:

summary(model_test2)
Called from: transformPredict(pred = preddata, model = object, newdata = newdata)
Browse[1]>

And the p[lotting also works without an error.

[niekdt]

Thanks @Pubuditha, good to hear you are not getting any errors anymore.

The 50+ warnings about "In FUN(newX[, i], ...) : no non-missing arguments to min; returning Inf" are coming from the kml package. I have no clue what aspect of your dataset would be triggering that. If you ever find out, please let me know so I can include it as a test case in the latrend package.

The Browse[1] part of the console output you posted concerned me, so I checked the latrend source code and it turns out there was a browser() statement in an error condition flow. I've now described and fixed this in #120.