A hierarchical NLP model using RoBERTa & ALBERT created to answer GCSE biology questions based on the Squad Question and Answer Dataset
Built within a colaboratory notebook, using PyTorch Transformers and Pre-Trained ALBERT model (on SQuAD dataset) Including a hierarchy of new sequence classifiers, trained on our novel Biology Dataset.