This repository contains machine learning related work for the corpus to graph project, including Jupyter research notebooks and a Flask webservice to host the model
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
demo_input
demo_output
packages
webservice
.gitignore
LICENSE
README.md
data_preparation.ipynb
features_classification.ipynb

README.md

corpus-to-graph-ml

This repository contains machine learning related work for the corpus to graph project, including Jupyter research notebooks and a Flask webservice to host the model.

The packages folder contains python code with the main logic for the data transformation and the feature generation tools.

 The webservice contains an example for a flask based scoring service that can be used in order to expose the trained model.

The data_preparation notebook contains an example of running the data transformation pipeline, and the features_classification notebook contains code examples for generating different features and training and evaluating different classifiers.

The only missing piece that shold be provided is an entity recognition endpoint (specifically here we used GNAT). You can also alternatively provide a text file with the results of the entity recognition process.

#Dependencies:

We highly recommend using the Anaconda distribution (or any similiar distribution), to make your life easier, as it comes with most of the packages we use in this notebook.

In our notebooks, we use the following libraries:

  • SKlearn (comes pre-installed with Anaconda)
  • NLTK (make sure to install the NLTK stopwords, lemmatization, and stemming packages by calling nltk.download() manually)
  • gensim (Make sure that you have cython installed beforehand in order run it the optimized version of the code)
  • spacy.io - For spacy - make sure you the english model installed
  • requests