Skip to content

sobamchan/pytorch-lightning-transformers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

pytorch-lightning-transformers Medium article

Setup

$ git clone https://github.com/sobamchan/pytorch-lightning-transformers.git
$ cd pytorch-lightning-transformers
$ pipenv install
$ pipenv shell

Usage

Fine-tune for CommonsenseQA with 2 gpus.

CUDA_VISIBLE_DEVICES=0,1 python csqa.py --gpus 2

Fine-tune for MRPC

$ python mrpc.py

This will load pre-trained BERT and fine-tune it with putting classification layer on top on MRPC task (paraphrase identification).

About

Fine-tune transformers with pytorch-lightning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages