99a_examples-muiltilabel.nbs seems not to use comment in blurr_predict

[interogativ]

I've git pulled your project and notebooks and had no problems with the 01_data_token_classifications.nbs. When I tried the 099a_multilabel_classification example, the output seemed reasonable at first. I decided to try substituting other sentences to learn.predict_blurr and got exactly the same results, not matter what I provided. My setup is similar to your test setup.

Using pytorch 1.7.1
Using fastai 2.3.1
Using transformers 4.3.2
Using GPU #0: NVIDIA GeForce GTX 1080

but because of cuda memory constraints, I set my bs=4

note that the result vector is always the same. I tried comments of different lengths too with the same resutls.

[ohmeow]

Have you tried training on the full, or at least larger subset, of the dataset in that notebook?

You also may want to improve/play with the learn.loss_func.thresh. Also, maybe more training will help. I only trained on less that 1% of the data and really didn't do much in the way of tuning my LRs or threshold.

Give it a go and lmk.

[ohmeow]

Closing this out. Will reopen if you report back that even on the full dataset you see same results.