Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

inference example #16

Merged
merged 4 commits into from
May 16, 2022
Merged

inference example #16

merged 4 commits into from
May 16, 2022

Conversation

rom1504
Copy link
Owner

@rom1504 rom1504 commented Mar 17, 2022

computing safety predictions on top of clip embeddings

@rom1504
Copy link
Owner Author

rom1504 commented Mar 18, 2022

https://www.tensorflow.org/guide/data#consuming_python_generators probably would be faster with this
(Already 100k sample/s but could be much faster, it's not using resources well)

examples/inference_example.py Show resolved Hide resolved
examples/inference_example.py Outdated Show resolved Hide resolved
@rom1504
Copy link
Owner Author

rom1504 commented Mar 18, 2022

This is WIP.
I'm not even sure I really want to put this here, I need to think some more about it

computing safety predictions on top of clip embeddings
@rom1504
Copy link
Owner Author

rom1504 commented May 16, 2022

works better, but still memleak

I think it's due to tf though and not embedding reader

something like https://stackoverflow.com/questions/64199384/tf-keras-model-predict-results-in-memory-leak

@rom1504 rom1504 mentioned this pull request May 16, 2022
@rom1504
Copy link
Owner Author

rom1504 commented May 16, 2022

works now and no memleak

@rom1504 rom1504 merged commit 42069f0 into main May 16, 2022
@rom1504 rom1504 deleted the inference-example branch May 16, 2022 00:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants