The following project aims at finetuning GPT-2 to a specific dataset in order to generate song lyrics. Indeed, training a pretrained model and a specific dataset can increase performance for a specific task.
Go here for Medium article explaining the project: https://medium.com/towards-data-science/how-to-fine-tune-gpt-2-for-text-generation-ae2ea53bc272
GPT2_final.ipynb contains all the training and finetuning of the GPT-2 model.
Lyrics_Dash_App.ipynb contains the code to create a web-based app with Dash, in order to automate lyrics generation.