Skip to content

Feature/bert #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 77 commits into
base: master
Choose a base branch
from
Open

Feature/bert #1

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
77 commits
Select commit Hold shift + click to select a range
875afb7
fhfile
rllin-fathom May 16, 2019
ad614a3
import walk path
rllin-fathom May 16, 2019
1b61541
turn on amp if fp16
rllin-fathom May 23, 2019
bef3ff6
use wrapper instead of flag
rllin-fathom May 24, 2019
fe58436
switch back to nvidia
rllin-fathom May 24, 2019
0e14818
switch back to nvidia amp
rllin-fathom May 24, 2019
ecb4337
tf amp
rllin-fathom May 24, 2019
83fc718
turn amp off
rllin-fathom May 24, 2019
94820a1
print
rllin-fathom May 24, 2019
9ccaed7
or amp
rllin-fathom May 24, 2019
651f03a
turn on TF_XLA_FLAGS=--tf_xla_cpu_global_jit
rllin-fathom May 24, 2019
7705548
use built in amp
rllin-fathom May 30, 2019
8b36ab8
fine tune run file
rllin-fathom Jun 4, 2019
4750f0c
clean up bert finetune
rllin-fathom Jun 5, 2019
f770029
clean up and hvd fp16
rllin-fathom Jun 6, 2019
7f14f2c
hparams data dir
rllin-fathom Jun 6, 2019
09f7c02
clean up and move amp
rllin-fathom Jun 6, 2019
ac331ab
clean
rllin-fathom Jun 6, 2019
a29bf2b
use classifier last layer
rllin-fathom Jun 6, 2019
adcda89
fix
rllin-fathom Jun 6, 2019
a7e761e
our top
rllin-fathom Jun 6, 2019
07c500c
lr
rllin-fathom Jun 6, 2019
0215da0
init config earlier
rllin-fathom Jun 6, 2019
65443d0
skip generate tfproto
rllin-fathom Jun 6, 2019
246b465
squad
rllin-fathom Jun 6, 2019
62fa7e8
seq length and comment
rllin-fathom Jun 7, 2019
e774acc
typo
rllin-fathom Jun 7, 2019
a905407
typo
rllin-fathom Jun 7, 2019
1cc0d47
compute type 32
rllin-fathom Jun 7, 2019
77f789a
move loss outside
rllin-fathom Jun 7, 2019
2841acc
barrier
rllin-fathom Jun 7, 2019
ee9cbd2
typo
rllin-fathom Jun 7, 2019
c494246
hvd input fn builder
rllin-fathom Jun 7, 2019
6445833
typo
rllin-fathom Jun 7, 2019
420a0af
try mock start positions
rllin-fathom Jun 7, 2019
a82b153
our top
rllin-fathom Jun 7, 2019
f75aafa
clean up
rllin-fathom Jun 7, 2019
c5385b1
loss
rllin-fathom Jun 7, 2019
c4f8e0a
hparams
rllin-fathom Jun 7, 2019
1ed1c76
hvd for partitioning
rllin-fathom Jun 7, 2019
0f95ae6
flags data dir
rllin-fathom Jun 7, 2019
0e28db1
print out ini
rllin-fathom Jun 8, 2019
fe8b825
oom hook
rllin-fathom Jun 8, 2019
df3c976
move out
rllin-fathom Jun 8, 2019
d50367d
instantiate
rllin-fathom Jun 8, 2019
8501f14
else
rllin-fathom Jun 8, 2019
09fc5fd
fix
rllin-fathom Jun 12, 2019
3aa196e
eval train loop
rllin-fathom Jun 13, 2019
081a1a7
do not need num labels
rllin-fathom Jun 13, 2019
9ce757d
barrier between train and eval
rllin-fathom Jun 13, 2019
7bac20c
fix
rllin-fathom Jun 13, 2019
7050721
use master process
rllin-fathom Jun 13, 2019
7f6fa4a
clean up print
rllin-fathom Jun 14, 2019
5c97155
fix hooks
rllin-fathom Jun 14, 2019
5a5ee89
clean
rllin-fathom Jun 14, 2019
b028fc7
no eval steps
rllin-fathom Jun 14, 2019
dd63f69
fix logging
rllin-fathom Jun 15, 2019
6d9fd1b
jsut eval
rllin-fathom Jun 15, 2019
a973d8d
steps = None
rllin-fathom Jun 15, 2019
834adec
update_op as second
rllin-fathom Jun 16, 2019
63b0045
put train back
rllin-fathom Jun 16, 2019
927ec70
only init on first loop
rllin-fathom Jun 16, 2019
1e3fed1
only init on first loop
rllin-fathom Jun 16, 2019
ea2434c
just eval
rllin-fathom Jun 18, 2019
26fdb5b
clean up
rllin-fathom Jun 19, 2019
3710f77
check previous checkpoints
rllin-fathom Jun 20, 2019
f63ca3d
sci
rllin-fathom Jun 20, 2019
95bfcc2
prints
rllin-fathom Jun 24, 2019
2b7f19a
scale LR
rllin-fathom Jun 24, 2019
b66741c
append init bert hook each time
rllin-fathom Jun 24, 2019
d008553
batching
rllin-fathom Jun 28, 2019
2a4f869
typo
rllin-fathom Jun 28, 2019
78822ce
clean
rllin-fathom Jun 28, 2019
da084d9
chunk before embeddings
rllin-fathom Jun 28, 2019
2fee2ea
no print
rllin-fathom Jun 28, 2019
de23b8a
do not expand
rllin-fathom Jun 28, 2019
a4ae57c
typo
rllin-fathom Jun 28, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading