misraya / baby_lm Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Pre-training language models with limited data

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
baseline_pretraining		baseline_pretraining
datasets		datasets
evaluation_pipeline		evaluation_pipeline
project		project
README.md		README.md

Repository files navigation

BabyLM Challenge

Pre-training language models with limited data

Dataset exploration
Tokenizer analysis
Baseline training
Tuning with task rewards

About

Pre-training language models with limited data

Report repository

Releases

No releases published

Packages

Languages