Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backport memory leak fix to patch spacy 2.0 and 2.1 #4538

Closed
kabirkhan opened this issue Oct 28, 2019 · 7 comments
Closed

Backport memory leak fix to patch spacy 2.0 and 2.1 #4538

kabirkhan opened this issue Oct 28, 2019 · 7 comments
Labels
bug Bugs and behaviour differing from documentation perf / memory Performance: memory use

Comments

@kabirkhan
Copy link
Contributor

Feature description

My team (and I assume a lot of other companies) are using spacy 2.0 and 2.1 in various places. We have A LOT of trained models in spacy 2.0 and 2.1. It would be great to have the fix @adrianeboyd made here #4486 for the memory leak ported back to the older versions as well since it's a really small change with a pretty huge impact.

i.e. It's much easier to upgrade to spacy 2.1.9 from 2.1.8 rather than 2.2.2 and retrain all the models we have.

Thanks!

And not sure this counts as a feature request but didn't seem like a bug either haha.

@svlandeg svlandeg added usage General spaCy usage perf / memory Performance: memory use labels Oct 28, 2019
@adrianeboyd adrianeboyd added bug Bugs and behaviour differing from documentation and removed usage General spaCy usage labels Oct 28, 2019
@adrianeboyd
Copy link
Contributor

It would be easy to backport this to 2.1. I'm less sure about 2.0 but I will look into it.

@adrianeboyd
Copy link
Contributor

I had to double-check to be sure, but 2.0 is not affected by this bug. A quick analysis didn't find any similar memory leaks in 2.0.

@ines
Copy link
Member

ines commented Oct 28, 2019

Here's a v2.1.x branch that we can add this to and release from: https://github.com/explosion/spaCy/tree/v2.1.x

@honnibal
Copy link
Member

Definitely happy to support this. Do you see any other patches you want while you're there?

Btw, a feature we haven't really advertised, but might be helpful for you: if you type "make" in the repo you'll get a dist/spacy.pex file. This is an executable that only depends on the Python interpreter on the system. When you run it it basically unzips a virtualenv and runs it --- it's like a jar file. So if you're using spaCy's CLI, it's a nice way to deploy.

@ines
Copy link
Member

ines commented Oct 28, 2019

@kabirkhan See #4542. v2.1.9 should be up soon – just building the sdist and wheels 🙌

@ines ines closed this as completed Oct 28, 2019
@kabirkhan
Copy link
Contributor Author

...meant to comment here not the PR:

Haha, our time difference is pretty evident here. Thank you all for the quick responses and for getting this out. Really appreciate the fast turnaround!

@lock
Copy link

lock bot commented Nov 27, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked as resolved and limited conversation to collaborators Nov 27, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Bugs and behaviour differing from documentation perf / memory Performance: memory use
Projects
None yet
Development

No branches or pull requests

5 participants