Flask RESTful API for News Summarization with Pegasus

Install

1. Install packages

   Note: Use python3.8 and update pip in virtual enviroment

   python3 -m venv env
   source env/bin/activate
   pip install -r requirements.txt

2. Create server.json for query (Only needed for Usage 2. and 3.)

   • Under the repository directory

     vim server.json

   • Inside server.json

     {
         "url": "your/server/url/for/query"
     }

Usage

1. Deploy REST API

   python src/summarizer.py

2. Test the API
   • Go through 1. first.
   • Modify the query in test_summarizer.py or add any news you want as string without using query.
   • Then:

     python test/test_summarizer.py

   If: ModuleNotFoundError: No module named 'gql.transport.aiohttp'
   Solution:

   pip uninstall gql
   pip install --pre gql[all]

3. Test Pegasus
   • Go through 1. first.
   • Modify the query in test_summarizer.py or add any news you want as string without using query.
   • You can also change different pretrained Pegasus from Hugging Face.
   • Then:

     python test/test_pegasus.py

   If: ModuleNotFoundError: No module named 'gql.transport.aiohttp'
   Solution:

   pip uninstall gql
   pip install --pre gql[all]

Citation

@misc{zhang2019pegasus,
    title={PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization},
    author={Jingqing Zhang and Yao Zhao and Mohammad Saleh and Peter J. Liu},
    year={2019},
    eprint={1912.08777},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}