Skip to content

llama3.np is a pure NumPy implementation for Llama 3 model.

License

Notifications You must be signed in to change notification settings

likejazz/llama3.np

Repository files navigation

llama3.np

llama3.cuda

llama3.np is a pure NumPy implementation for Llama 3 model. For an accurate implementation, I ran the stories15M model trained by Andrej Karpathy.

Usage

$ python llama3.py "I have a dream"
"""
I have a dream. He dream of a big, beautiful garden full of flower and tree. He dream of playing with hi friend and eating yummy snack.
One day, he wa walking in the garden when he saw

Token count: 50, elapsed: 1.53s, 33 tokens/s
"""

Citing llama3.np

If you use or discuss llama3.np in your academic research, please cite the project to help spread awareness:

@misc{llama3.np,
  title = {llama3.np: pure NumPy implementation for Llama 3 model},
  author = {Sang Park}, 
  howpublished = {\url{https://github.com/likejazz/llama3.np}},
  note = {llama3.np, MIT License}
  year = {2024},
}

References

Thank you to the creators of the following libraries and tools and their contributors:

I got a lot of information from the articles below:

And title image was generated by DALL-E

License

MIT

About

llama3.np is a pure NumPy implementation for Llama 3 model.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages