Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FourQ requires AVX2 instruction #321

Closed
gxcuit opened this issue May 22, 2024 · 2 comments
Closed

FourQ requires AVX2 instruction #321

gxcuit opened this issue May 22, 2024 · 2 comments
Labels
no-issue-activity

Comments

@gxcuit
Copy link

gxcuit commented May 22, 2024 •
edited
Loading

Hi, 我在使用v0.8.0b0 版本， 按照入门教程进行部署

在执行example 的时候，报错 FourQ requires AVX2 instruction

在之前的版本0.7.0中，用默认曲线CURVE_FOURQ 也会有这个问题， 但是只要换成CURVE_SM2, 就可以正常运行。

但是，v0.8.0b0 依旧报错 FourQ requires AVX2 instruction

2024-05-22T13:20:58.075442326+08:00 stderr F 2024-05-22 05:20:58.074 ERROR component.py:1129 [alice] -- [Anonymous_job] eval on domain: "data_prep"
2024-05-22T13:20:58.075510477+08:00 stderr F name: "psi"
2024-05-22T13:20:58.075529535+08:00 stderr F version: "0.0.5"
2024-05-22T13:20:58.07554525+08:00 stderr F attr_paths: "input/receiver_input/key"
2024-05-22T13:20:58.075559838+08:00 stderr F attr_paths: "input/sender_input/key"
2024-05-22T13:20:58.075573386+08:00 stderr F attr_paths: "protocol"
2024-05-22T13:20:58.07559049+08:00 stderr F attr_paths: "precheck_input"
2024-05-22T13:20:58.075603228+08:00 stderr F attr_paths: "bucket_size"
2024-05-22T13:20:58.075615383+08:00 stderr F attr_paths: "curve_type"
2024-05-22T13:20:58.075627604+08:00 stderr F attr_paths: "left_side"
2024-05-22T13:20:58.075639585+08:00 stderr F attrs {
2024-05-22T13:20:58.075652246+08:00 stderr F   ss: "id1"
2024-05-22T13:20:58.075664457+08:00 stderr F }
2024-05-22T13:20:58.075708695+08:00 stderr F attrs {
2024-05-22T13:20:58.075722347+08:00 stderr F   ss: "id2"
2024-05-22T13:20:58.075734238+08:00 stderr F }
2024-05-22T13:20:58.075745722+08:00 stderr F attrs {
2024-05-22T13:20:58.075766987+08:00 stderr F   s: "PROTOCOL_ECDH"
2024-05-22T13:20:58.075779218+08:00 stderr F }
2024-05-22T13:20:58.075834717+08:00 stderr F attrs {
2024-05-22T13:20:58.075852075+08:00 stderr F   b: true
2024-05-22T13:20:58.075863786+08:00 stderr F }
2024-05-22T13:20:58.075874844+08:00 stderr F attrs {
2024-05-22T13:20:58.075885938+08:00 stderr F   i64: 1048576
2024-05-22T13:20:58.075897349+08:00 stderr F }
2024-05-22T13:20:58.07590844+08:00 stderr F attrs {
2024-05-22T13:20:58.075919955+08:00 stderr F   s: "CURVE_SM2"
2024-05-22T13:20:58.075931213+08:00 stderr F }
2024-05-22T13:20:58.075942147+08:00 stderr F attrs {
2024-05-22T13:20:58.075953225+08:00 stderr F   ss: "alice"
2024-05-22T13:20:58.075964253+08:00 stderr F }
2024-05-22T13:20:58.075975454+08:00 stderr F inputs {
2024-05-22T13:20:58.075986798+08:00 stderr F   name: "alice.csv"
2024-05-22T13:20:58.075998096+08:00 stderr F   type: "sf.table.individual"
2024-05-22T13:20:58.076010007+08:00 stderr F   meta {
2024-05-22T13:20:58.076035762+08:00 stderr F     type_url: "type.googleapis.com/secretflow.spec.v1.IndividualTable"
2024-05-22T13:20:58.076049207+08:00 stderr F     value: "\n\335\003\022\003id1\022\003age\022\teducation\022\007default\022\007balance\022\007housing\022\004loan\022\003day\022\010duration\022\010campaign\022\005pdays\022\010previous\022\017job_blue-collar\022\020job_entrepreneur\022\rjob_housemaid\022\016job_management\022\013job_retired\022\021job_self-employed\022\014job_services\022\013job_student\022\016job_technician\022\016job_unemployed\022\020marital_divorced\022\017marital_married\022\016marital_single*\003str*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\377\377\377\377\377\377\377\377\377\001"
2024-05-22T13:20:58.076082751+08:00 stderr F   }
2024-05-22T13:20:58.076094342+08:00 stderr F   data_refs {
2024-05-22T13:20:58.076105723+08:00 stderr F     uri: "alice.csv"
2024-05-22T13:20:58.076117114+08:00 stderr F     party: "alice"
2024-05-22T13:20:58.076128445+08:00 stderr F     format: "csv"
2024-05-22T13:20:58.076139719+08:00 stderr F   }
2024-05-22T13:20:58.076151207+08:00 stderr F }
2024-05-22T13:20:58.076162811+08:00 stderr F inputs {
2024-05-22T13:20:58.076174299+08:00 stderr F   name: "bob.csv"
2024-05-22T13:20:58.07618597+08:00 stderr F   type: "sf.table.individual"
2024-05-22T13:20:58.076197495+08:00 stderr F   meta {
2024-05-22T13:20:58.076209066+08:00 stderr F     type_url: "type.googleapis.com/secretflow.spec.v1.IndividualTable"
2024-05-22T13:20:58.07622222+08:00 stderr F     value: "\n\227\003\022\003id2\022\020contact_cellular\022\021contact_telephone\022\017contact_unknown\022\tmonth_apr\022\tmonth_aug\022\tmonth_dec\022\tmonth_feb\022\tmonth_jan\022\tmonth_jul\022\tmonth_jun\022\tmonth_mar\022\tmonth_may\022\tmonth_nov\022\tmonth_oct\022\tmonth_sep\022\020poutcome_failure\022\016poutcome_other\022\020poutcome_success\022\020poutcome_unknown\022\001y*\003str*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\003int\020\377\377\377\377\377\377\377\377\377\001"
2024-05-22T13:20:58.076234328+08:00 stderr F   }
2024-05-22T13:20:58.076245956+08:00 stderr F   data_refs {
2024-05-22T13:20:58.0762573+08:00 stderr F     uri: "bob.csv"
2024-05-22T13:20:58.076268844+08:00 stderr F     party: "bob"
2024-05-22T13:20:58.076279985+08:00 stderr F     format: "csv"
2024-05-22T13:20:58.076291216+08:00 stderr F   }
2024-05-22T13:20:58.076303104+08:00 stderr F }
2024-05-22T13:20:58.076314866+08:00 stderr F output_uris: "psi-output.csv"
2024-05-22T13:20:58.076327677+08:00 stderr F  failed, error <�[36mray::SPURuntime.psi()�[39m (pid=865, ip=secretflow-task-20240522132029-single-psi-0-global.alice.svc, actor_id=9cbfa62e3389d6244557f73901000000, repr=SPURuntime(device_id=None, party=alice))
2024-05-22T13:20:58.076354906+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/spu.py", line 1379, in psi
2024-05-22T13:20:58.076367531+08:00 stderr F     report = spu.psi.psi(config, self.link)
2024-05-22T13:20:58.076379102+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/spu/psi.py", line 118, in psi
2024-05-22T13:20:58.076390503+08:00 stderr F     report_str = libpsi.libs.psi(
2024-05-22T13:20:58.076401931+08:00 stderr F RuntimeError: what: 
2024-05-22T13:20:58.076413815+08:00 stderr F 	[Enforce fail at external/psi/psi/cryptor/cryptor_selector.cc:92] cryptor != nullptr. FourQ requires AVX2 instruction
2024-05-22T13:20:58.076427446+08:00 stderr F Stacktrace:
2024-05-22T13:20:58.076439437+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.076451022+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.076462193+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.076473311+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.076484308+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.076495513+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.076507237+08:00 stderr F 
2024-05-22T13:20:58.076518622+08:00 stderr F stacktrace: 
2024-05-22T13:20:58.076536876+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.076637953+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.076656265+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.076668152+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.076679597+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.076691088+08:00 stderr F #5 cfunction_call+0x4fc697>
2024-05-22T13:20:58.07681743+08:00 stderr F 2024-05-22 05:20:58.075 INFO api.py:342 [alice] -- [Anonymous_job] Shutdowning rayfed intendedly...
2024-05-22T13:20:58.076874348+08:00 stderr F 2024-05-22 05:20:58.076 INFO api.py:356 [alice] -- [Anonymous_job] No wait for data sending.
2024-05-22T13:20:58.080955415+08:00 stderr F 2024-05-22 05:20:58.080 INFO message_queue.py:72 [alice] -- [Anonymous_job] Notify message polling thread[DataSendingQueueThread] to exit.
2024-05-22T13:20:58.081051044+08:00 stderr F 2024-05-22 05:20:58.080 INFO message_queue.py:72 [alice] -- [Anonymous_job] Notify message polling thread[ErrorSendingQueueThread] to exit.
2024-05-22T13:20:58.081603986+08:00 stderr F 2024-05-22 05:20:58.081 INFO api.py:384 [alice] -- [Anonymous_job] Shutdowned rayfed.
2024-05-22T13:20:58.084094278+08:00 stderr F 2024-05-22 05:20:58.083 WARNING cleanup.py:154 [alice] -- [Anonymous_job] Failed to send ObjectRef(359ec6ce30d3ca2ddc82ebc537929f9be812fa650100000001000000) to bob, error: �[36mray::SenderReceiverProxyActor.send()�[39m (pid=789, ip=secretflow-task-20240522132029-single-psi-0-global.alice.svc, actor_id=dc82ebc537929f9be812fa6501000000, repr=<fed.proxy.barriers.SenderReceiverProxyActor object at 0x7f7ff1a5f610>)
2024-05-22T13:20:58.084143599+08:00 stderr F   At least one of the input arguments for this task could not be computed:
2024-05-22T13:20:58.084160501+08:00 stderr F ray.exceptions.RayTaskError: �[36mray::SPURuntime.psi()�[39m (pid=865, ip=secretflow-task-20240522132029-single-psi-0-global.alice.svc, actor_id=9cbfa62e3389d6244557f73901000000, repr=SPURuntime(device_id=None, party=alice))
2024-05-22T13:20:58.084175646+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/spu.py", line 1379, in psi
2024-05-22T13:20:58.084188534+08:00 stderr F     report = spu.psi.psi(config, self.link)
2024-05-22T13:20:58.084200851+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/spu/psi.py", line 118, in psi
2024-05-22T13:20:58.084233831+08:00 stderr F     report_str = libpsi.libs.psi(
2024-05-22T13:20:58.084248059+08:00 stderr F RuntimeError: what: 
2024-05-22T13:20:58.08426098+08:00 stderr F 	[Enforce fail at external/psi/psi/cryptor/cryptor_selector.cc:92] cryptor != nullptr. FourQ requires AVX2 instruction
2024-05-22T13:20:58.084272785+08:00 stderr F Stacktrace:
2024-05-22T13:20:58.084284913+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.084296857+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.084308268+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.084319652+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.08433104+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.084342531+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.084353592+08:00 stderr F 
2024-05-22T13:20:58.084367027+08:00 stderr F stacktrace: 
2024-05-22T13:20:58.084378978+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.084391349+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.08440295+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.084414461+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.084425832+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.08443682+08:00 stderr F #5 cfunction_call+0x4fc697,upstream_seq_id: 10#0, downstream_seq_id: 12.
2024-05-22T13:20:58.085866368+08:00 stderr F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [290.915]       perfetto.cc:47470 Tracing session 1 ended, total sessions:0
2024-05-22T13:20:58.085936694+08:00 stderr F 2024-05-22 05:20:58.084 INFO cleanup.py:161 [alice] -- [Anonymous_job] Sending error what: 
2024-05-22T13:20:58.08595779+08:00 stderr F 	[Enforce fail at external/psi/psi/cryptor/cryptor_selector.cc:92] cryptor != nullptr. FourQ requires AVX2 instruction
2024-05-22T13:20:58.085970651+08:00 stderr F Stacktrace:
2024-05-22T13:20:58.085989883+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.086002957+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.086014605+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.08602878+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.086040334+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.086051595+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.086062033+08:00 stderr F 
2024-05-22T13:20:58.086073441+08:00 stderr F stacktrace: 
2024-05-22T13:20:58.086084748+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.086095886+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.086106944+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.086118131+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.086129242+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.08614021+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.086151181+08:00 stderr F 
2024-05-22T13:20:58.086163012+08:00 stderr F  to bob.
2024-05-22T13:20:58.088091937+08:00 stderr F Exception in thread DataSendingQueueThread:
2024-05-22T13:20:58.088132485+08:00 stderr F Traceback (most recent call last):
2024-05-22T13:20:58.088148419+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/fed/cleanup.py", line 152, in _process_data_sending_task_return
2024-05-22T13:20:58.088658154+08:00 stderr F     res = ray.get(obj_ref)
2024-05-22T13:20:58.088707675+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/ray/_private/auto_init_hook.py", line 22, in auto_init_wrapper
2024-05-22T13:20:58.089166282+08:00 stderr F     return fn(*args, **kwargs)
2024-05-22T13:20:58.089204912+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/ray/_private/client_mode_hook.py", line 103, in wrapper
2024-05-22T13:20:58.089511084+08:00 stderr F     return func(*args, **kwargs)
2024-05-22T13:20:58.089545961+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/ray/_private/worker.py", line 2624, in get
2024-05-22T13:20:58.090755838+08:00 stderr F     raise value.as_instanceof_cause()
2024-05-22T13:20:58.090837129+08:00 stderr F ray.exceptions.RayTaskError(RuntimeError): �[36mray::SenderReceiverProxyActor.send()�[39m (pid=789, ip=secretflow-task-20240522132029-single-psi-0-global.alice.svc, actor_id=dc82ebc537929f9be812fa6501000000, repr=<fed.proxy.barriers.SenderReceiverProxyActor object at 0x7f7ff1a5f610>)
2024-05-22T13:20:58.090857304+08:00 stderr F   At least one of the input arguments for this task could not be computed:
2024-05-22T13:20:58.090886037+08:00 stderr F ray.exceptions.RayTaskError: �[36mray::SPURuntime.psi()�[39m (pid=865, ip=secretflow-task-20240522132029-single-psi-0-global.alice.svc, actor_id=9cbfa62e3389d6244557f73901000000, repr=SPURuntime(device_id=None, party=alice))
2024-05-22T13:20:58.090901515+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/spu.py", line 1379, in psi
2024-05-22T13:20:58.090922397+08:00 stderr F     report = spu.psi.psi(config, self.link)
2024-05-22T13:20:58.090935005+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/spu/psi.py", line 118, in psi
2024-05-22T13:20:58.09094706+08:00 stderr F     report_str = libpsi.libs.psi(
2024-05-22T13:20:58.090960101+08:00 stderr F RuntimeError: what: 
2024-05-22T13:20:58.090972825+08:00 stderr F 	[Enforce fail at external/psi/psi/cryptor/cryptor_selector.cc:92] cryptor != nullptr. FourQ requires AVX2 instruction
2024-05-22T13:20:58.090994214+08:00 stderr F Stacktrace:
2024-05-22T13:20:58.091006645+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.09101908+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.091031041+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.091042885+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.091054616+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.091066137+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.091077458+08:00 stderr F 
2024-05-22T13:20:58.091089476+08:00 stderr F stacktrace: 
2024-05-22T13:20:58.091101534+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.091113789+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.091125953+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.091137974+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.091149889+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.091161743+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.091172921+08:00 stderr F 
2024-05-22T13:20:58.091184775+08:00 stderr F During handling of the above exception, another exception occurred:
2024-05-22T13:20:58.091225142+08:00 stderr F 
2024-05-22T13:20:58.091242758+08:00 stderr F Traceback (most recent call last):
2024-05-22T13:20:58.091255422+08:00 stderr F   File "/usr/local/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
2024-05-22T13:20:58.091505702+08:00 stderr F     self.run()
2024-05-22T13:20:58.091537905+08:00 stderr F   File "/usr/local/lib/python3.10/threading.py", line 953, in run
2024-05-22T13:20:58.092041806+08:00 stderr F     self._target(*self._args, **self._kwargs)
2024-05-22T13:20:58.092071676+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/fed/_private/message_queue.py", line 51, in _loop
2024-05-22T13:20:58.092204961+08:00 stderr F     res = self._msg_handler(message)
2024-05-22T13:20:58.092288489+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/fed/cleanup.py", line 47, in <lambda>
2024-05-22T13:20:58.092483751+08:00 stderr F     lambda msg: self._process_data_sending_task_return(msg),
2024-05-22T13:20:58.092510513+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/fed/cleanup.py", line 166, in _process_data_sending_task_return
2024-05-22T13:20:58.092957949+08:00 stderr F     send(
2024-05-22T13:20:58.092996239+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/fed/proxy/barriers.py", line 502, in send
2024-05-22T13:20:58.102723092+08:00 stderr F     get_global_context().get_cleanup_manager().push_to_sending(
2024-05-22T13:20:58.102789195+08:00 stderr F AttributeError: 'NoneType' object has no attribute 'get_cleanup_manager'
2024-05-22T13:20:58.707190264+08:00 stderr F Traceback (most recent call last):
2024-05-22T13:20:58.707262784+08:00 stderr F   File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-05-22T13:20:58.707634876+08:00 stderr F     return _run_code(code, main_globals, None,
2024-05-22T13:20:58.707664075+08:00 stderr F   File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
2024-05-22T13:20:58.708008928+08:00 stderr F     exec(code, run_globals)
2024-05-22T13:20:58.708037627+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 547, in <module>
2024-05-22T13:20:58.708678301+08:00 stderr F     main()
2024-05-22T13:20:58.708727982+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
2024-05-22T13:20:58.709429118+08:00 stderr F     return self.main(*args, **kwargs)
2024-05-22T13:20:58.709508322+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main
2024-05-22T13:20:58.710098925+08:00 stderr F     rv = self.invoke(ctx)
2024-05-22T13:20:58.710128627+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
2024-05-22T13:20:58.7109355+08:00 stderr F     return ctx.invoke(self.callback, **ctx.params)
2024-05-22T13:20:58.711003676+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
2024-05-22T13:20:58.711565902+08:00 stderr F     return __callback(*args, **kwargs)
2024-05-22T13:20:58.711638259+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 527, in main
2024-05-22T13:20:58.712016671+08:00 stderr F     res = comp_eval(sf_node_eval_param, storage_config, sf_cluster_config)
2024-05-22T13:20:58.712047071+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/entry.py", line 166, in comp_eval
2024-05-22T13:20:58.712439241+08:00 stderr F     res = comp.eval(
2024-05-22T13:20:58.712472531+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1131, in eval
2024-05-22T13:20:58.713264129+08:00 stderr F     raise e from None
2024-05-22T13:20:58.713311397+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1126, in eval
2024-05-22T13:20:58.713984397+08:00 stderr F     ret = self.__eval_callback(ctx=ctx, **kwargs)
2024-05-22T13:20:58.714045646+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/data_prep/psi.py", line 371, in two_party_balanced_psi_eval_fn
2024-05-22T13:20:58.714406276+08:00 stderr F     report = spu.psi(
2024-05-22T13:20:58.714433493+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/spu.py", line 2097, in psi
2024-05-22T13:20:58.715524902+08:00 stderr F     return dispatch(
2024-05-22T13:20:58.71557017+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/register.py", line 111, in dispatch
2024-05-22T13:20:58.715871314+08:00 stderr F     return _registrar.dispatch(self.device_type, name, self, *args, **kwargs)
2024-05-22T13:20:58.7159353+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/register.py", line 80, in dispatch
2024-05-22T13:20:58.716218587+08:00 stderr F     return self._ops[device_type][name](*args, **kwargs)
2024-05-22T13:20:58.71625405+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/kernels/spu.py", line 615, in psi
2024-05-22T13:20:58.716825778+08:00 stderr F     return sfd.get(res)
2024-05-22T13:20:58.716875606+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/distributed/primitive.py", line 156, in get
2024-05-22T13:20:58.717160746+08:00 stderr F     return fed.get(object_refs)
2024-05-22T13:20:58.717195769+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/fed/api.py", line 621, in get
2024-05-22T13:20:58.726212665+08:00 stderr F     values = ray.get(ray_refs)
2024-05-22T13:20:58.726265643+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/ray/_private/auto_init_hook.py", line 22, in auto_init_wrapper
2024-05-22T13:20:58.726465632+08:00 stderr F     return fn(*args, **kwargs)
2024-05-22T13:20:58.726492958+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/ray/_private/client_mode_hook.py", line 103, in wrapper
2024-05-22T13:20:58.726864713+08:00 stderr F     return func(*args, **kwargs)
2024-05-22T13:20:58.726896426+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/ray/_private/worker.py", line 2624, in get
2024-05-22T13:20:58.728120032+08:00 stderr F     raise value.as_instanceof_cause()
2024-05-22T13:20:58.728199459+08:00 stderr F ray.exceptions.RayTaskError(RuntimeError): �[36mray::SPURuntime.psi()�[39m (pid=865, ip=secretflow-task-20240522132029-single-psi-0-global.alice.svc, actor_id=9cbfa62e3389d6244557f73901000000, repr=SPURuntime(device_id=None, party=alice))
2024-05-22T13:20:58.72824774+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/device/device/spu.py", line 1379, in psi
2024-05-22T13:20:58.728264065+08:00 stderr F     report = spu.psi.psi(config, self.link)
2024-05-22T13:20:58.72827714+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/spu/psi.py", line 118, in psi
2024-05-22T13:20:58.728289281+08:00 stderr F     report_str = libpsi.libs.psi(
2024-05-22T13:20:58.728301539+08:00 stderr F RuntimeError: what: 
2024-05-22T13:20:58.7283207+08:00 stderr F 	[Enforce fail at external/psi/psi/cryptor/cryptor_selector.cc:92] cryptor != nullptr. FourQ requires AVX2 instruction
2024-05-22T13:20:58.728332985+08:00 stderr F Stacktrace:
2024-05-22T13:20:58.728345649+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.728357887+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.728369665+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.728381566+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.728393364+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.728405458+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.728416606+08:00 stderr F 
2024-05-22T13:20:58.728428361+08:00 stderr F stacktrace: 
2024-05-22T13:20:58.728440578+08:00 stderr F #0 psi::ecdh::EcdhPsiReceiver::PreProcess()+0x7fc97d78ef34
2024-05-22T13:20:58.728452553+08:00 stderr F #1 psi::RunPsi()+0x7fc97d781ab0
2024-05-22T13:20:58.728464327+08:00 stderr F #2 psi::BindLibs()::{lambda()#3}::operator()()+0x7fc97d777205
2024-05-22T13:20:58.728475735+08:00 stderr F #3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fc97d777483
2024-05-22T13:20:58.728487179+08:00 stderr F #4 pybind11::cpp_function::dispatcher()+0x7fc97d75943d
2024-05-22T13:20:58.728498504+08:00 stderr F #5 cfunction_call+0x4fc697
2024-05-22T13:20:58.734930583+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:57.825] [info] [launch.cc:119] PSI config: {"protocol_config":{"protocol":"PROTOCOL_ECDH","role":"ROLE_RECEIVER","broadcast_result":true,"ecdh_config":{"curve":"CURVE_FOURQ"}},"input_config":{"type":"IO_TYPE_FILE_CSV","path":"/home/kuscia/var/storage/data/alice.csv"},"output_config":{"type":"IO_TYPE_FILE_CSV","path":"/home/kuscia/var/storage/data/psi-output.csv"},"keys":["id1"],"left_side":"ROLE_RECEIVER"}
2024-05-22T13:20:58.73504719+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:57.825] [info] [receiver.cc:41] [EcdhPsiReceiver::Init] start
2024-05-22T13:20:58.735066315+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:57.825] [info] [interface.cc:78] [AbstractPsiParty::Init] start
2024-05-22T13:20:58.735079543+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:57.833] [info] [interface.cc:136] [AbstractPsiParty::Init][Check csv pre-process] start
2024-05-22T13:20:58.735092828+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:57.899] [info] [csv_checker.cc:243] Executing script to get duplicates: LC_ALL=C tail -n +2 /tmp/88f063cb-9e52-4adb-97ba-84f10073c110.psi_checked | LC_ALL=C sort --parallel=12 --buffer-size=1G --stable | LC_ALL=C uniq -d > /tmp/88f063cb-9e52-4adb-97ba-84f10073c110.psi_checked_duplicates
2024-05-22T13:20:58.735105725+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:58.036] [info] [interface.cc:145] [AbstractPsiParty::Init][Check csv pre-process] end
2024-05-22T13:20:58.735117727+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:58.037] [info] [interface.cc:183] [AbstractPsiParty::Init] end
2024-05-22T13:20:58.735140149+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:58.037] [info] [receiver.cc:49] [EcdhPsiReceiver::Init] end
2024-05-22T13:20:58.735153284+08:00 stdout F �[36m(SPURuntime(device_id=None, party=alice) pid=865)�[0m [2024-05-22 05:20:58.037] [info] [receiver.cc:54] [EcdhPsiReceiver::PreProcess] start
@gxcuit
Copy link
Author

gxcuit commented May 22, 2024

找到原因了 ecdh_curve

@gxcuit gxcuit mentioned this issue May 22, 2024
Open
@github-actions GitHub Actions
Copy link

Stale issue message. Please comment to remove stale tag. Otherwise this issue will be closed soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
no-issue-activity
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@gxcuit