Skip to content

javismiles/X-Ray-Transformer

master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 

X-Ray-Transformer Infographic

Dive into transformers training & inference computations through a single visual, an all in one x-ray of the model that gave rise to GPT-3. Explore computations and transformations end to end during training and inference. The X-Ray Transformer infographic allows you to make the journey from the beginning to the end of the transformer's computations in both the training and inference phases. Its objective is to achieve a quick and deep understanding of the inner computations of a transformer model through the analysis and exploration of a single visual asset.

Find a step by step explanation of the X-Ray Transformer Infographic at this medium article I published:

https://towardsdatascience.com/x-ray-transformer-dive-into-transformers-training-inference-computations-through-a-single-visual-4e8d50667378

Download a higher resolution version of the Infographic at:

https://github.com/javismiles/X-Ray-Transformer/tree/master/images

Even larger resolution versions of the Infographic will be released soon at losslandscape.com

Alt text

About

Infographic about the inner computations of a transformer model, training and inference

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published