Question Answering using Albert and Electra using wikipedia text as context.
This repository implements a pipeline to answer questions using wikipedia text. Bellow is the pipeline:
- Using the input query, search on google filtering the wikipedia pages.
- Read the body content of the wikipedia, preprocess text and split the corpus in paragraphs.
- Using BM25 algoritm rank the best candidate passages, using the top K paragraphs.
- Selected paragraphs are used as input to Albert and Electra models.
- Both models try to find the answer given the candidate paragraphs.
