Skip to content

Latest commit

 

History

History
16 lines (14 loc) · 608 Bytes

File metadata and controls

16 lines (14 loc) · 608 Bytes

Question Answering with transformer models e.g. GPT

Setup Environment

conda create -n hf_transformer_pt python=3.8
conda activate hf_transformer_pt
conda install pytorch torchvision torchaudio pytorch-cuda=11.6 -c pytorch -c nvidia
pip install transformers
conda install jupyter
pip install chardet
pip install pandas
pip install scikit-learn

Dataset link:-

https://www.microsoft.com/en-us/research/project/newsqa-dataset/download/

The stories(contexts) can be found in:-

https://drive.google.com/uc?export=download&id=0BwmD_VLjROrfTHk4NFg2SndKcjQ