Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dpr embedding error: TypeError: can't pickle _thread.lock objects #185

Closed
LemonSqi opened this issue Mar 20, 2023 · 3 comments
Closed

dpr embedding error: TypeError: can't pickle _thread.lock objects #185

LemonSqi opened this issue Mar 20, 2023 · 3 comments
Assignees

Comments

@LemonSqi
Copy link

run demo example abnormal.
`from towhee import pipe, ops, DataCollection

if name == 'main':
p = (
pipe.input('text')
.map('text', 'vec', ops.text_embedding.dpr(model_name='facebook/dpr-ctx_encoder-single-nq-base'))
.output('text', 'vec')
)

DataCollection(p('Hello, world.')).show()`

Traceback (most recent call last):
File "F:/Project/towhee_test/main.py", line 7, in
.output('text', 'vec')
File "E:\Anaconda3\envs\towhee_env\lib\site-packages\towhee\runtime\pipeline.py", line 103, in output
dag_dict = deepcopy(self._dag)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 281, in _reconstruct
state = deepcopy(state, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 169, in deepcopy
rv = reductor(4)
TypeError: can't pickle _thread.lock objects

Process finished with exit code 1

@Shiftwa
Copy link

Shiftwa commented Mar 20, 2023

flet-dev/flet#565

@Chiiizzzy
Copy link
Contributor

run demo example abnormal. `from towhee import pipe, ops, DataCollection

if name == 'main': p = ( pipe.input('text') .map('text', 'vec', ops.text_embedding.dpr(model_name='facebook/dpr-ctx_encoder-single-nq-base')) .output('text', 'vec') )

DataCollection(p('Hello, world.')).show()`

Traceback (most recent call last): File "F:/Project/towhee_test/main.py", line 7, in .output('text', 'vec') File "E:\Anaconda3\envs\towhee_env\lib\site-packages\towhee\runtime\pipeline.py", line 103, in output dag_dict = deepcopy(self._dag) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy y = copier(x, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict y[deepcopy(key, memo)] = deepcopy(value, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy y = copier(x, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict y[deepcopy(key, memo)] = deepcopy(value, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy y = copier(x, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict y[deepcopy(key, memo)] = deepcopy(value, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 180, in deepcopy y = _reconstruct(x, memo, *rv) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 281, in _reconstruct state = deepcopy(state, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 150, in deepcopy y = copier(x, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 241, in _deepcopy_dict y[deepcopy(key, memo)] = deepcopy(value, memo) File "E:\Anaconda3\envs\towhee_env\lib\copy.py", line 169, in deepcopy rv = reductor(4) TypeError: can't pickle _thread.lock objects

Process finished with exit code 1

Are you using towhee <= 0.9? If so, please import pipe and ops from dc2:
from towhee.dc2 import pipe, ops, DataCollection

@LemonSqi
Copy link
Author

this problem is solved, thanks a lot~!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants