Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Logging token level losses at inference time #4169

Merged
Show file tree
Hide file tree
Changes from 9 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
ea54029
first draft
c-flaherty Nov 11, 2021
1c63fd7
fix
c-flaherty Nov 11, 2021
f4a7d6d
added rank logging and regression-based unit test
c-flaherty Nov 12, 2021
cb761c7
some notes
c-flaherty Nov 12, 2021
ca45cf2
removed unnecessary prefixing in test
c-flaherty Nov 12, 2021
8df50f5
fix callsite
c-flaherty Nov 12, 2021
200cbcb
actually this fixed the callsite
c-flaherty Nov 12, 2021
e74c159
addressed stephens PR feedback
c-flaherty Nov 18, 2021
36dcc73
Merge branch 'main' into add_token_level_probability_logging_TGA
c-flaherty Nov 18, 2021
d5b0ef2
addressed Emilys PR feedback
c-flaherty Nov 29, 2021
449b5e5
fixed linting
c-flaherty Nov 29, 2021
1aeabeb
fix
c-flaherty Nov 29, 2021
a5b2d7c
fix
c-flaherty Nov 29, 2021
1d89ac7
addressed emily pr feedback
c-flaherty Dec 1, 2021
53f7350
addressed Emily PR feedback, adding select_paths unit testing
c-flaherty Dec 7, 2021
9aa7987
address Emily feedback p2
c-flaherty Dec 7, 2021
8b6437e
linting and comments
c-flaherty Dec 7, 2021
22ec560
make code more efficient
c-flaherty Dec 8, 2021
d67a0ee
linting
c-flaherty Dec 9, 2021
0aff113
fix test
c-flaherty Dec 13, 2021
e268c80
Merge remote-tracking branch 'origin' into add_token_level_probabilit…
c-flaherty Dec 14, 2021
80f5a81
fix test
c-flaherty Dec 15, 2021
98adeab
fix broken gpu tests
c-flaherty Dec 16, 2021
e231341
fix more tests
c-flaherty Dec 16, 2021
be52baf
fixed another gpu test
c-flaherty Dec 17, 2021
d56ac13
fix long_gpu_tests + linting
c-flaherty Dec 21, 2021
70c7eba
Merge remote-tracking branch 'origin' into add_token_level_probabilit…
c-flaherty Dec 21, 2021
32d1a0b
try skipping rag tests and see if cache issue resolves
c-flaherty Dec 22, 2021
bde9069
bump cache again to see if skippping rag/fid tests helps
c-flaherty Dec 22, 2021
3381841
Merge remote-tracking branch 'origin' into add_token_level_probabilit…
c-flaherty Dec 22, 2021
254de6c
addressed Emily PR feedback
c-flaherty Jan 3, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view