This project aims to eliminate wasting considerable time thinking about the pull-request name by automated the pull request naming process. We take four different approaches.
- Original BART model “Facebook/bart-base”. code
- Feature extraction + The BART model.
- Feature extraction + The two BART model. code
- Feature extraction + The BART model + TextRank algorithm. code
We used PRTiger dataset.
| Model | ROUGE-1 | ROUGE-2 | ROUGE-L |
|---|---|---|---|
| BART | 46.8684 | 25.0862 | 42.9303 |
| BART + preprocessing | 46.5925 | 24.7061 | 42.7126 |
| BART + preprocessing + BART | 45.6653 | 23.9111 | 41.6356 |
| BART + preprocessing + TextRank + BART | 46.3706 | 24.5945 | 42.4827 |