Skip to content

This project aims to implement text summarization using Google's Pegasus model, leveraging the Samsum dataset. Pegasus is a state-of-the-art model for abstractive text summarization, pre-trained on a large corpus of text data. The Samsum dataset contains conversational summaries, making it suitable for various summarization tasks.

License

Notifications You must be signed in to change notification settings

SoumyadiptaKar/Text-Summarization

Repository files navigation

End to end Dialogue Based Text-Summarization Project using Samsum Dataset

This project aims to implement text summarization using Google's Pegasus model, leveraging the Samsum dataset. Pegasus is a state-of-the-art model for abstractive text summarization, pre-trained on a large corpus of text data. The Samsum dataset contains conversational summaries, making it suitable for various summarization tasks.

Workflows used for the project.

  1. Update config.yaml
  2. Update params.yaml
  3. Update entity
  4. Update configuration manager is src/config
  5. Update components
  6. Update pipeline
  7. Update main.py
  8. Update app.py

Steps to run the code:

Step 01 - Clone the repository

https://github.com/SoumyadiptaKar/Text-Summarization.git

Step 02 -Create conda envourenment

conda create -n summary python=3.8 -y
conda activate summary

Step 03 - Install the requirements

pip install -r requirements.txt

Step 04 - Run the app

python app.py
Author: Soumyadipta Kar
Email: soumyadipta.kar2002@gmail.com

Colab Outputs :

Prediction 1: image

Prediction 2: image

Deployment Using FastAPI :

2024-03-11.22-42-33.online-video-cutter.com.mp4

About

This project aims to implement text summarization using Google's Pegasus model, leveraging the Samsum dataset. Pegasus is a state-of-the-art model for abstractive text summarization, pre-trained on a large corpus of text data. The Samsum dataset contains conversational summaries, making it suitable for various summarization tasks.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published