Skip to content
This repository has been archived by the owner on Mar 1, 2022. It is now read-only.

Conjugation example reproducability #17

Open
obsh opened this issue Feb 1, 2020 · 2 comments
Open

Conjugation example reproducability #17

obsh opened this issue Feb 1, 2020 · 2 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@obsh
Copy link

obsh commented Feb 1, 2020

Hi, I'm running fitbert in the Google Colab Notebook,
first time example with conjugation works but in each subsequent execution it substitutes masked with "looks" not "looking".

Notebook link: https://colab.research.google.com/drive/1o1pOO-ozEOHOKO5_j48_TbwgYyP1U7b8

image

@sam-writer sam-writer added bug Something isn't working and removed bug Something isn't working labels May 21, 2020
@sam-writer
Copy link
Contributor

hmmm... this seems to have to do with caching:

image

Notice how the second request is ~30x faster

@sam-writer
Copy link
Contributor

I can't think where any caching would be happening though...

@sam-writer sam-writer added bug Something isn't working help wanted Extra attention is needed labels Jun 9, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants