Unable load spacy with pyintsaller on other system

[AshishDhadwal]

I had created an exe file which works fine on my system but when i try to run on other system i was unable to load the model.

Your Environment

• Operating System:Windows 10
• Python Version Used:3.6
• spaCy Version Used:2.0.18
• Environment Information:64 bit

When i run exe in other system in which python is not installed its throws me below error

File "spacy\util.py", line 109, in load_model
OSError: [E049] Can't find spaCy data directory: 'None'. Check your installation and permissions, or use spacy.util.set_data_path to customise the location if necessary.

I had set spacy.util.set_data_path to to data location
In my .spec file i had included below imports:

datas=[("D:/anaconda3/Lib/site-packages/ftfy/char_classes.dat", "ftfy"),('model1.json', '.' ),('model1.h5', '.' ),('wordcloud\*.py','wordcloud'),('wordcloud\*.pyd','wordcloud'),('wordcloud\__pycache__\*.pyc','wordcloud'),('wordcloud\stopwords','wordcloud'),('wordcloud\DroidSansMono.ttf','wordcloud'),('D:/anaconda3/Lib/site-packages/spacy/data','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/*.py','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm/*.py','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm/*.json','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm/*.py','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm/__pycache__/*.pyc','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm/en_core_web_sm-2.0.0/*.json','spacy'),('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm/en_core_web_sm-2.0.0','spacy')],
             hiddenimports=['cython','sklearn.pipeline' ,'sklearn', 'sklearn.ensemble', 'sklearn.neighbors.typedefs', 'sklearn.neighbors.quad_tree', 'sklearn.tree._utils','h5py.defs', 'h5py.utils', 'h5py.h5ac', 'h5py._proxy','PIL','cymem.cymem', 'thinc.linalg', 'murmurhash.mrmr', 'cytoolz.utils', 'cytoolz._signatures', 'spacy.strings', 'spacy.morphology', 'spacy.lexeme', 'spacy.tokens', 'spacy.gold', 'spacy.tokens.underscore', 'spacy.parts_of_speech', 'dill', 'spacy.tokens.printers', 'spacy.tokens._retokenize', 'spacy.syntax', 'spacy.syntax.stateclass', 'spacy.syntax.transition_system', 'spacy.syntax.nonproj', 'spacy.syntax.nn_parser', 'spacy.syntax.arc_eager', 'thinc.extra.search', 'spacy.syntax._beam_utils', 'spacy.syntax.ner', 'thinc.neural._classes.difference', 'spacy.vocab', 'spacy.lemmatizer', 'spacy._ml', 'ftfy', 'spacy.lang', 'spacy.lang.en','spacy.util','pylab'],

Any help would be highly appreciated ?

[ines]

Where are you calling set_data_path?

And does importing the model as a module work? If it's installed correctly, you should also be able to do the following:

import en_core_web_sm

nlp = en_core_web_sm.load()

[AshishDhadwal]

i set data path below:
spacy.util.set_data_path('D:/anaconda3/Lib/site-packages/spacy/data/en_core_web_sm')

&
import en_core_web_sm

nlp = en_core_web_sm.load()

i am able load model with these two commands.

Spacy is not able to work in exe mode on other system.

[ines]

I think the path is the problem here: The data path should be the path to the data directory, not the model itself:

spacy.util.set_data_path('D:/anaconda3/Lib/site-packages/spacy/data')

Also, you might want to check out #2536 for more details on spaCy + PyInstaller.

[no-response]

This issue has been automatically closed because there has been no response to a request for more information from the original author. With only the information that is currently in the issue, there's not enough information to take action. If you're the original author, feel free to reopen the issue if you have or find the answers needed to investigate further.

[AshishDhadwal]

Please include this in your py script after sleepless nights i was able to load exe

def resource_path(relative_path):
    """ Get absolute path to resource, works for dev and for PyInstaller """
    base_path = getattr(sys, '_MEIPASS', os.path.dirname(os.path.abspath("__file__")))
    return os.path.join(base_path, relative_path)

spacy.util.set_data_path= resource_path('D:/anaconda3/Lib/site-packages/spacy/data')



nlp = spacy.load('en_core_web_sm')

and in .spec file

datas =[('D:\anaconda3\Lib\site-packages\spacy\data','.'),('D:\anaconda3\Lib\site-packages\spacy\data\en_core_web_sm','spacy\data\en_core_web_sm'),('D:\anaconda3\Lib\site-packages\en_core_web_sm','en_core_web_sm'),('D:\anaconda3\Lib\site-packages\spacy\data\en_core_web_sm\en_core_web_sm-2.0.0','spacy\data\en_core_web_sm\en_core_web_sm-2.0.0')]

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.