Skip to content

BERT vs Fasttext#1298

Merged
RohithKuditipudi merged 10 commits into
mainfrom
bert-vs-fasttext-pr
May 19, 2025
Merged

BERT vs Fasttext#1298
RohithKuditipudi merged 10 commits into
mainfrom
bert-vs-fasttext-pr

Conversation

@RohithKuditipudi

Copy link
Copy Markdown
Contributor

Description

Experiment script for #163.

Comment thread experiments/exp163_bert.py Outdated
Comment thread experiments/exp163_bert.py Outdated
Comment thread experiments/exp163_bert.py
Comment thread experiments/exp163_bert.py Outdated
Comment thread experiments/exp163_bert.py Outdated
Comment thread experiments/exp163_bert.py Outdated
Comment thread experiments/exp163_bert.py Outdated
Comment thread experiments/exp163_bert.py Outdated
steps.extend(bert_consolidate_steps)

# dolmino_dclm = get_dolmino_step_llama3("dclm")
for fasttext_consolidate_step, bert_consolidate_step in zip(

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is cleaner to just have this in the same for loop above under keep_fraction so you don't have to do zip and worry about things being mis-aligned.

Comment thread experiments/exp163_bert.py
@RohithKuditipudi RohithKuditipudi merged commit 43172b0 into main May 19, 2025
5 checks passed
@rjpower rjpower deleted the bert-vs-fasttext-pr branch January 21, 2026 00:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants