Skip to content

MiniGPT-0 (Research Preview – Apr 30, 2025)

Pre-release
Pre-release

Choose a tag to compare

View all tags
@MEME-KING16 MEME-KING16 released this 30 Apr 23:34
· 3 commits to main since this release
v0.1.0-preview
775e57b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

preview

⚠️ Research Preview

This release of MiniGPT-0-preview is intended for research and educational use only.
It is not aligned, safety-tested, or ready for deployment in production or user-facing applications.
Pretrained weights are licensed for non-commercial research.

MiniGPT-0 (Preview)

Release Date: 2025-04-30
Checkpoint: minigpt0-preview.pth
License: MIT (code), research-only (weights)
Device: CPU or GPU compatible

Model Specs

Feature Value
Parameters ~7.3M
Layers 6
Heads 4
Embedding Dim 256
Feedforward Dim 1024
Block Size 128 tokens
Vocab Size 5000
Dropout 0.1
Framework PyTorch

Training Info

  • Trained on: 15% OpenAssistant
  • Model type: GPT-style decoder-only
  • Epochs: 3
  • Steps: 211,740 (70,580x3)
  • Loss: 2.375 (token-wise cross-entropy)
Assets 3
Loading