Skip to content

v3mini-eval1 — English (1800-1875)

Latest

Choose a tag to compare

@haykgrigo3 haykgrigo3 released this 11 Jul 12:51
· 1 commit to main since this release
2c83983

TimeCapsuleLLM v3mini-eval1 — London (1800–1875)

Weights & tokenizer hosted on Hugging Face:
➡️ https://huggingface.co/haykgrigorian/TimeCapsuleLLM-English-1800-1875-v3mini-eval1-500M

Dataset hosted on Hugging Face:
➡️ https://huggingface.co/datasets/haykgrigorian/english-historical-corpus-1800-1875-15GB-sample/tree/main/representative_samples/sample_5b_tokens

About This Release

  • LlamaCausalLM trained from scratch on 5B tokens
  • 500M parameters
  • Trained to 13K steps
  • Evaluation model for v3