Skip to content

ish-codes-magic/transformer_from_scratch

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits

README.md

README.md

 
 

config.py

config.py

 
 

dataset.py

dataset.py

 
 

decoder.py

decoder.py

 
 

embeddings.py

embeddings.py

 
 

encoder.py

encoder.py

 
 

feed_forward.py

feed_forward.py

 
 

layer_norm.py

layer_norm.py

 
 

mha.py

mha.py

 
 

model.py

model.py

 
 

pos_enc.py

pos_enc.py

 
 

projection.py

projection.py

 
 

residual_connection.py

residual_connection.py

 
 

train.py

train.py

 
 

Repository files navigation

Transformer model implementation from scratch

In this project, I have to implement the model proposed in the Attention is all you need paper.

I have used the following stack to create the project:

  1. Python
  2. Pytorch
  3. Hugging Face tokenisers
  4. Hugging Face Opus Books Dataset

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

6 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages