Transformer Models in NLP
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
transformer_main
LICENSE
README.md
attention_main.py

README.md

transformers-nlp

This project contains implementation of transformer models being used in NLP research for various tasks.

This repo contains

Requirements

  • Pytorch == 1.0.0

Getting Started

To create a Transformer

from attention_main import *   
model = create_transformer(5, 5)
model_opt = get_trans_optim(model)
criterion = LabelSmoothing(size=5, padding_idx=0, smoothing=0.0)
fit_transformer(generate_data(5, 30, 20), model, loss_compute(model.generator,criterion,model_opt))

More functionalities are work in progress.