Multitenancy

[amn41]

addresses #36

• server can serve multiple apps simultaneously, sharing a single nlp instance, if all models are spaCy and in the same language
• to use, replace server_model_dir in config.json with a json obj, e.g. "server_model_dir":{"one":"model_XXXXX","two":"model_YYYY"} where the keys act as aliases. Then add a model param to HTTP requests, e.g. localhost:5000/parse?q=hello&model=one
• added documentation explaining how to use
• added test_multitenancy.py

[vinvinod]

Hi @amn41
I have modified the mitie backend to suppor the multitenancy for rasa.
My MITIE fork is at https://github.com/verloop/MITIE/tree/master
and Rasa fork is at verloop@8073f5d

Let me know what you think about this.

[amn41]

looks cool! I'll check it out. Are there any mitie compatibility issues, e.g. could your branch in principle be merged into MITIE master?

[vinvinod]

Yes, It can be merged into MITIE master.
But I have modified only the named_entity_extractor and text_categorizer classes for taking a total_word_feature_extractor as an input during predicting phase. I have not touched binary_relation_detector.

In the original implementaion of MITIE, get_feature_vector() of total_word_feature_extractor used the same temp variable (to avoid reallocating) for storing intermediate values. But now its allocated freshly for each function call. So these changes might not be suitable for general MITIE users.

[vinvinod]

You can take a look at the relevant PR for MITIE mit-nlp/MITIE#88

[vinvinod]

The PR mit-nlp/MITIE#88 has been accepted. So now we can provide a feature extractor while doing the prediction. Its there for both named_entity_extractor and text_categorizer
I have already made the required changes for mitie interpreter and featurizer.
Its in #149

[amr-elsehemy]

Hi I'm currently working on a developing a multi tenant application based on rasa, and I was wondering if there's more thorough documentation for this part available ? @amn41

[YazanMasafah]

Where I can find the documentation for achieving multi-tenancy?