JAX implementation of 'Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training'
-
Updated
May 23, 2024 - Python
#
sophia
Here are 7 public repositories matching this topic...
Super-Convergence on CIFAR10
sophia
cifar10
lion
second-order-optimization
adamw
super-convergence
weight-decay
sharpness-aware-minimization
madgrad
large-batch-optimization
lion-optimizer
-
Updated
Jun 17, 2024 - Python
Implementing and fine-tuning BERT for sentiment analysis, paraphrase detection, and semantic textual similarity tasks. Includes code, data, and detailed results.
python
natural-language-processing
deep-learning
sentiment-analysis
tensorflow
transformers
pytorch
semantic-similarity
sophia
bert
adamw-optimizer
paraphrase-detection
-
Updated
Jan 18, 2024 - Python
sophia optimizer further projected towards flat areas of loss landscape
-
Updated
Aug 19, 2024 - Python
Natural Language Processing, Speech Dictation, API controllers
-
Updated
Jan 23, 2023 - Python
Sophia robot bringup and test expressions and animations
-
Updated
Jan 18, 2019 - Python
Improve this page
Add a description, image, and links to the sophia topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the sophia topic, visit your repo's landing page and select "manage topics."