Save and load the bot detection model from modelforge

[warenlg]

Once the bot detection model has been trained and has reached good performance, we have to save it to asdf format and upload the model to modelforge. The corresponding script has been PR here #73. The tree includes:

• The booster XGBoost model
• The dict of parameters used to train the model
• The BPE model

[warenlg]

Issue 1.

First pushing the model to modelforge failed with the following error message:

pkg_resources.VersionConflict: (semantic-version 2.8.2 (/home/waren/.local/lib/python3.6/site-packages), Requirement.parse('semantic-version<=2.6.0,>=2.3.1'))

The issue comes from asdf and is labelled with high-priority asdf-format/asdf#702.
A quick workaround is to downgrade semantic-version to version 2.6.0

[warenlg]

Issue 2.

After saving the model using the sklearn API behind XGBClassifier, if we load the model with load_model xgboost native function, we hit the following error when trying to predict() something:
AttributeError: 'XGBClassifier' object has no attribute '_le'

The issue has already been raised here and the xgboost maintainers recommend to save the model using pickle for sklearn models objects like XGBClasssifier dmlc/xgboost#3829

[warenlg]

Both issues above are overcome:

1. by bumping asdf to 2.4.2 in modelforge Bump asdf version in requirements modelforge#107
2. by adding the line xgb_cls._le = LabelEncoder().fit([False, True]) in the code snippet example usage in Add bot detection model models#28

[vmarkovtsev]

Shall we close then?

[warenlg]

It is waiting for src-d/models#28 merging

[warenlg]

src-d/models#28 is merged so we can close this.