Skip to content
#

rms-norm

Star

Here are 2 public repositories matching this topic...

Language: All
Filter by language
All 2 Jupyter Notebook 1 Python 1

aju22 / LLaMA2

Star 53

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture and the inference process. The code is restructured and heavily commented to facilitate easy understanding of the key parts of the architecture.

natural-language-processing transformer attention llama gpt rope kv-cache llm llama2 rms-norm
  • Updated Oct 1, 2023
  • Python

Improve this page

Add a description, image, and links to the rms-norm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rms-norm topic, visit your repo's landing page and select "manage topics."

Learn more