NeuralPushkin / ruPALM- Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

PALM based architicure with rotary positional embeddings

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
README.md		README.md
requirements.txt		requirements.txt
ruDECODER (1).ipynb		ruDECODER (1).ipynb
ruPalm.py		ruPalm.py

Repository files navigation

ruPALM-

PALM based architicure with rotary positional embeddings

Dataset

90m model with rotation emb(gonna be released)
350m model(2m+)
1.3b
2.7b
6b
13b

About

PALM based architicure with rotary positional embeddings

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages