You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
2024-07-10T18:51:37.724884316+08:00 stderr F WARNING:root:Since the GPL-licensed package `unidecode` is not installed, using Python's `unicodedata` package which yields worse results.2024-07-10T18:51:38.433441838+08:00 stdout F 2024-07-10 10:51:38,432|p169|INFO|secretflow|entry.py:start_ray:59| ray_conf: RayConfig(ray_node_ip_address='jaf4vv5bhka06ugr-0-global.p169.svc', ray_node_manager_port=31470, ray_object_manager_port=31471, ray_client_server_port=31472, ray_worker_ports=[], ray_gcs_port=31475)2024-07-10T18:51:38.433516254+08:00 stdout F 2024-07-10 10:51:38,432|p169|INFO|secretflow|entry.py:start_ray:63| Trying to start ray head node at jaf4vv5bhka06ugr-0-global.p169.svc, start command: RAY_BACKEND_LOG_LEVEL=debug RAY_grpc_enable_http_proxy=true OMP_NUM_THREADS=4 ray start --head --include-dashboard=false --disable-usage-stats --num-cpus=32 --node-ip-address=jaf4vv5bhka06ugr-0-global.p169.svc --port=31475 --node-manager-port=31470 --object-manager-port=31471 --ray-client-server-port=314722024-07-10T18:51:41.15345814+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:start_ray:80| 2024-07-10 10:51:39,041 INFO usage_lib.py:423 -- Usage stats collection is disabled.2024-07-10T18:51:41.153477371+08:00 stdout F 2024-07-10 10:51:39,041 INFO scripts.py:744 -- Local node IP: jaf4vv5bhka06ugr-0-global.p169.svc2024-07-10T18:51:41.153481538+08:00 stdout F 2024-07-10 10:51:40,988 SUCC scripts.py:781 -- --------------------2024-07-10T18:51:41.153483986+08:00 stdout F 2024-07-10 10:51:40,988 SUCC scripts.py:782 -- Ray runtime started.2024-07-10T18:51:41.153497457+08:00 stdout F 2024-07-10 10:51:40,988 SUCC scripts.py:783 -- --------------------2024-07-10T18:51:41.153501952+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:785 -- Next steps2024-07-10T18:51:41.153504316+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:788 -- To add another node to this Ray cluster, run2024-07-10T18:51:41.153507589+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:791 -- ray start --address='jaf4vv5bhka06ugr-0-global.p169.svc:31475'2024-07-10T18:51:41.153510028+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:800 -- To connect to this Ray cluster:2024-07-10T18:51:41.153512303+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:802 -- import ray2024-07-10T18:51:41.153515033+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:803 -- ray.init(_node_ip_address='jaf4vv5bhka06ugr-0-global.p169.svc')2024-07-10T18:51:41.153517318+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:834 -- To terminate the Ray runtime, run2024-07-10T18:51:41.153519517+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:835 -- ray stop2024-07-10T18:51:41.153521858+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:838 -- To view the status of the cluster, use2024-07-10T18:51:41.153524081+08:00 stdout F 2024-07-10 10:51:40,989 INFO scripts.py:839 -- ray status2024-07-10T18:51:41.153526177+08:00 stdout F 2024-07-10T18:51:41.1535295+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:start_ray:81| Succeeded to start ray head node at jaf4vv5bhka06ugr-0-global.p169.svc.2024-07-10T18:51:41.153531965+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:main:510| datasource.access_directly True2024-07-10T18:51:41.153534623+08:00 stdout F sf_node_eval_param {2024-07-10T18:51:41.153538305+08:00 stdout F "domain": "preprocessing",2024-07-10T18:51:41.153540611+08:00 stdout F "name": "onehot_encode",2024-07-10T18:51:41.153542732+08:00 stdout F "version": "0.0.3",2024-07-10T18:51:41.153544997+08:00 stdout F "attrPaths": [2024-07-10T18:51:41.153548005+08:00 stdout F "input/input_data/feature_selects",2024-07-10T18:51:41.153550284+08:00 stdout F "drop",2024-07-10T18:51:41.153552543+08:00 stdout F "min_frequency",2024-07-10T18:51:41.153554718+08:00 stdout F "report_rules"2024-07-10T18:51:41.153556895+08:00 stdout F ],2024-07-10T18:51:41.153559177+08:00 stdout F "attrs": [2024-07-10T18:51:41.153561378+08:00 stdout F {2024-07-10T18:51:41.153563605+08:00 stdout F "ss": [2024-07-10T18:51:41.153574194+08:00 stdout F "kasieg_11",2024-07-10T18:51:41.153576697+08:00 stdout F "kasieg_12",2024-07-10T18:51:41.153579226+08:00 stdout F "kasieg_13",2024-07-10T18:51:41.153581407+08:00 stdout F "kasieg_14",2024-07-10T18:51:41.153583572+08:00 stdout F "kasieg_15",2024-07-10T18:51:41.153585931+08:00 stdout F "kasieg_16",2024-07-10T18:51:41.153588175+08:00 stdout F "kasieg_17",2024-07-10T18:51:41.153590369+08:00 stdout F "kasieg_18",2024-07-10T18:51:41.153592505+08:00 stdout F "kasieg_19",2024-07-10T18:51:41.153594693+08:00 stdout F "kasieg_20",2024-07-10T18:51:41.15359693+08:00 stdout F "kasieg_1",2024-07-10T18:51:41.153599102+08:00 stdout F "kasieg_2",2024-07-10T18:51:41.153601586+08:00 stdout F "kasieg_3",2024-07-10T18:51:41.153603755+08:00 stdout F "kasieg_4",2024-07-10T18:51:41.15360596+08:00 stdout F "kasieg_5",2024-07-10T18:51:41.153608194+08:00 stdout F "kasieg_6",2024-07-10T18:51:41.15361041+08:00 stdout F "kasieg_7",2024-07-10T18:51:41.153612577+08:00 stdout F "kasieg_8",2024-07-10T18:51:41.153614839+08:00 stdout F "kasieg_9",2024-07-10T18:51:41.153617046+08:00 stdout F "kasieg_10"2024-07-10T18:51:41.15361919+08:00 stdout F ]2024-07-10T18:51:41.153621487+08:00 stdout F },2024-07-10T18:51:41.153829208+08:00 stdout F {2024-07-10T18:51:41.153833217+08:00 stdout F "s": "no_drop"2024-07-10T18:51:41.153835534+08:00 stdout F },2024-07-10T18:51:41.153837923+08:00 stdout F {},2024-07-10T18:51:41.153840178+08:00 stdout F {2024-07-10T18:51:41.153842462+08:00 stdout F "b": true2024-07-10T18:51:41.153844749+08:00 stdout F }2024-07-10T18:51:41.153847004+08:00 stdout F ]2024-07-10T18:51:41.153849383+08:00 stdout F } 2024-07-10T18:51:41.17003918+08:00 stdout F 2024-07-10 10:51:41,169|p169|INFO|secretflow|entry.py:domaindata_id_to_dist_data:160| domaindata_id e1449345-psi-dataset to 2024-07-10T18:51:41.170070859+08:00 stdout F ...........2024-07-10T18:51:41.170077362+08:00 stdout F name: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:41.170082447+08:00 stdout F type: "sf.table.vertical_table"2024-07-10T18:51:41.170086295+08:00 stdout F system_info {2024-07-10T18:51:41.17009023+08:00 stdout F }2024-07-10T18:51:41.170094095+08:00 stdout F meta {2024-07-10T18:51:41.170099545+08:00 stdout F type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"2024-07-10T18:51:41.170104605+08:00 stdout F value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"2024-07-10T18:51:41.170108688+08:00 stdout F }2024-07-10T18:51:41.170112475+08:00 stdout F data_refs {2024-07-10T18:51:41.170116408+08:00 stdout F uri: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:41.170120444+08:00 stdout F party: "p169"2024-07-10T18:51:41.170124245+08:00 stdout F format: "csv"2024-07-10T18:51:41.170127931+08:00 stdout F }2024-07-10T18:51:41.170131918+08:00 stdout F data_refs {2024-07-10T18:51:41.170135657+08:00 stdout F uri: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:41.17013939+08:00 stdout F party: "p170"2024-07-10T18:51:41.170143316+08:00 stdout F format: "csv"2024-07-10T18:51:41.170147011+08:00 stdout F }2024-07-10T18:51:41.170150546+08:00 stdout F 2024-07-10T18:51:41.170154319+08:00 stdout F ....2024-07-10T18:51:41.177938203+08:00 stderr F 2024-07-10 10:51:41,171 INFO worker.py:1540 -- Connecting to existing Ray cluster at address: jaf4vv5bhka06ugr-0-global.p169.svc:31475...2024-07-10T18:51:41.177981066+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:159| 2024-07-10T18:51:41.177985316+08:00 stdout F --2024-07-10T18:51:41.177988497+08:00 stdout F Secretflow 1.6.1b02024-07-10T18:51:41.177992137+08:00 stdout F Build time (May 27 2024, 04:48:06) with commit id: eac355f390d9d0d7276ee4cea8d1fe38417cabb62024-07-10T18:51:41.177994425+08:00 stdout F --2024-07-10T18:51:41.177996533+08:00 stdout F 2024-07-10T18:51:41.177998842+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:160| 2024-07-10T18:51:41.178001479+08:00 stdout F --2024-07-10T18:51:41.17800402+08:00 stdout F *param* 2024-07-10T18:51:41.17800615+08:00 stdout F 2024-07-10T18:51:41.178008439+08:00 stdout F domain: "preprocessing"2024-07-10T18:51:41.178010676+08:00 stdout F name: "onehot_encode"2024-07-10T18:51:41.178012965+08:00 stdout F version: "0.0.3"2024-07-10T18:51:41.178016124+08:00 stdout F attr_paths: "input/input_data/feature_selects"2024-07-10T18:51:41.178018376+08:00 stdout F attr_paths: "drop"2024-07-10T18:51:41.178021519+08:00 stdout F attr_paths: "min_frequency"2024-07-10T18:51:41.178023784+08:00 stdout F attr_paths: "report_rules"2024-07-10T18:51:41.178026047+08:00 stdout F attrs {2024-07-10T18:51:41.178028388+08:00 stdout F ss: "kasieg_11"2024-07-10T18:51:41.178030749+08:00 stdout F ss: "kasieg_12"2024-07-10T18:51:41.178033125+08:00 stdout F ss: "kasieg_13"2024-07-10T18:51:41.17803539+08:00 stdout F ss: "kasieg_14"2024-07-10T18:51:41.178037599+08:00 stdout F ss: "kasieg_15"2024-07-10T18:51:41.178039848+08:00 stdout F ss: "kasieg_16"2024-07-10T18:51:41.178042168+08:00 stdout F ss: "kasieg_17"2024-07-10T18:51:41.17804444+08:00 stdout F ss: "kasieg_18"2024-07-10T18:51:41.178047121+08:00 stdout F ss: "kasieg_19"2024-07-10T18:51:41.178049936+08:00 stdout F ss: "kasieg_20"2024-07-10T18:51:41.178052289+08:00 stdout F ss: "kasieg_1"2024-07-10T18:51:41.178054545+08:00 stdout F ss: "kasieg_2"2024-07-10T18:51:41.178056769+08:00 stdout F ss: "kasieg_3"2024-07-10T18:51:41.178058913+08:00 stdout F ss: "kasieg_4"2024-07-10T18:51:41.178061099+08:00 stdout F ss: "kasieg_5"2024-07-10T18:51:41.178063323+08:00 stdout F ss: "kasieg_6"2024-07-10T18:51:41.178065543+08:00 stdout F ss: "kasieg_7"2024-07-10T18:51:41.178067663+08:00 stdout F ss: "kasieg_8"2024-07-10T18:51:41.178069871+08:00 stdout F ss: "kasieg_9"2024-07-10T18:51:41.178072064+08:00 stdout F ss: "kasieg_10"2024-07-10T18:51:41.178074271+08:00 stdout F }2024-07-10T18:51:41.178076477+08:00 stdout F attrs {2024-07-10T18:51:41.178078679+08:00 stdout F s: "no_drop"2024-07-10T18:51:41.178080871+08:00 stdout F }2024-07-10T18:51:41.178083097+08:00 stdout F attrs {2024-07-10T18:51:41.178085266+08:00 stdout F }2024-07-10T18:51:41.178087432+08:00 stdout F attrs {2024-07-10T18:51:41.178089668+08:00 stdout F b: true2024-07-10T18:51:41.178091828+08:00 stdout F }2024-07-10T18:51:41.17809401+08:00 stdout F inputs {2024-07-10T18:51:41.178097125+08:00 stdout F name: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:41.178099477+08:00 stdout F type: "sf.table.vertical_table"2024-07-10T18:51:41.178101734+08:00 stdout F system_info {2024-07-10T18:51:41.178103919+08:00 stdout F }2024-07-10T18:51:41.178106085+08:00 stdout F meta {2024-07-10T18:51:41.178108341+08:00 stdout F type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"2024-07-10T18:51:41.178111548+08:00 stdout F value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"2024-07-10T18:51:41.178116342+08:00 stdout F }2024-07-10T18:51:41.178118701+08:00 stdout F data_refs {2024-07-10T18:51:41.178121025+08:00 stdout F uri: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:41.178123334+08:00 stdout F party: "p169"2024-07-10T18:51:41.178125586+08:00 stdout F format: "csv"2024-07-10T18:51:41.178127763+08:00 stdout F }2024-07-10T18:51:41.178130003+08:00 stdout F data_refs {2024-07-10T18:51:41.178132267+08:00 stdout F uri: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:41.178134486+08:00 stdout F party: "p170"2024-07-10T18:51:41.178136794+08:00 stdout F format: "csv"2024-07-10T18:51:41.178138971+08:00 stdout F }2024-07-10T18:51:41.178141188+08:00 stdout F }2024-07-10T18:51:41.178143466+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-output_dataset"2024-07-10T18:51:41.178145726+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-onehot_rules"2024-07-10T18:51:41.178147956+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-report"2024-07-10T18:51:41.178149978+08:00 stdout F 2024-07-10T18:51:41.178152211+08:00 stdout F --2024-07-10T18:51:41.178154257+08:00 stdout F 2024-07-10T18:51:41.178156509+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:161| 2024-07-10T18:51:41.178158743+08:00 stdout F --2024-07-10T18:51:41.178161007+08:00 stdout F *storage_config* 2024-07-10T18:51:41.178163041+08:00 stdout F 2024-07-10T18:51:41.178165195+08:00 stdout F type: "local_fs"2024-07-10T18:51:41.178167411+08:00 stdout F local_fs {2024-07-10T18:51:41.178169655+08:00 stdout F wd: "/home/kuscia/var/storage/data"2024-07-10T18:51:41.17817184+08:00 stdout F }2024-07-10T18:51:41.17817391+08:00 stdout F 2024-07-10T18:51:41.178176129+08:00 stdout F --2024-07-10T18:51:41.178178187+08:00 stdout F 2024-07-10T18:51:41.178180446+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:162| 2024-07-10T18:51:41.178182627+08:00 stdout F --2024-07-10T18:51:41.178184807+08:00 stdout F *cluster_config* 2024-07-10T18:51:41.178186822+08:00 stdout F 2024-07-10T18:51:41.178189002+08:00 stdout F desc {2024-07-10T18:51:41.178191204+08:00 stdout F parties: "p169"2024-07-10T18:51:41.17819347+08:00 stdout F parties: "p170"2024-07-10T18:51:41.17819613+08:00 stdout F devices {2024-07-10T18:51:41.178198353+08:00 stdout F name: "spu"2024-07-10T18:51:41.178200588+08:00 stdout F type: "spu"2024-07-10T18:51:41.178202789+08:00 stdout F parties: "p169"2024-07-10T18:51:41.178205068+08:00 stdout F parties: "p170"2024-07-10T18:51:41.178208426+08:00 stdout F config: "{\"runtime_config\":{\"protocol\":\"REF2K\",\"field\":\"FM64\"},\"link_desc\":{\"connect_retry_times\":60,\"connect_retry_interval_ms\":1000,\"brpc_channel_protocol\":\"http\",\"brpc_channel_connection_type\":\"pooled\",\"recv_timeout_ms\":1200000,\"http_timeout_ms\":1200000}}"2024-07-10T18:51:41.178210682+08:00 stdout F }2024-07-10T18:51:41.178212975+08:00 stdout F devices {2024-07-10T18:51:41.178215198+08:00 stdout F name: "heu"2024-07-10T18:51:41.178217381+08:00 stdout F type: "heu"2024-07-10T18:51:41.178219952+08:00 stdout F parties: "p169"2024-07-10T18:51:41.178222116+08:00 stdout F parties: "p170"2024-07-10T18:51:41.17822434+08:00 stdout F config: "{\"mode\": \"PHEU\", \"schema\": \"paillier\", \"key_size\": 2048}"2024-07-10T18:51:41.178226574+08:00 stdout F }2024-07-10T18:51:41.178228823+08:00 stdout F ray_fed_config {2024-07-10T18:51:41.178231104+08:00 stdout F cross_silo_comm_backend: "brpc_link"2024-07-10T18:51:41.178233298+08:00 stdout F }2024-07-10T18:51:41.178235463+08:00 stdout F }2024-07-10T18:51:41.178239047+08:00 stdout F public_config {2024-07-10T18:51:41.178241239+08:00 stdout F ray_fed_config {2024-07-10T18:51:41.178245492+08:00 stdout F parties: "p169"2024-07-10T18:51:41.178247787+08:00 stdout F parties: "p170"2024-07-10T18:51:41.178250007+08:00 stdout F addresses: "0.0.0.0:31474"2024-07-10T18:51:41.17825229+08:00 stdout F addresses: "jaf4vv5bhka06ugr-0-fed.p170.svc:80"2024-07-10T18:51:41.178254504+08:00 stdout F }2024-07-10T18:51:41.178256682+08:00 stdout F spu_configs {2024-07-10T18:51:41.178258967+08:00 stdout F name: "spu"2024-07-10T18:51:41.178261153+08:00 stdout F parties: "p169"2024-07-10T18:51:41.178263379+08:00 stdout F parties: "p170"2024-07-10T18:51:41.178265609+08:00 stdout F addresses: "0.0.0.0:31473"2024-07-10T18:51:41.178267854+08:00 stdout F addresses: "http://jaf4vv5bhka06ugr-0-spu.p170.svc:80"2024-07-10T18:51:41.178270083+08:00 stdout F }2024-07-10T18:51:41.178272532+08:00 stdout F }2024-07-10T18:51:41.178274775+08:00 stdout F private_config {2024-07-10T18:51:41.178276915+08:00 stdout F self_party: "p169"2024-07-10T18:51:41.178279139+08:00 stdout F ray_head_addr: "jaf4vv5bhka06ugr-0-global.p169.svc:31475"2024-07-10T18:51:41.178281387+08:00 stdout F }2024-07-10T18:51:41.178283439+08:00 stdout F 2024-07-10T18:51:41.178285559+08:00 stdout F --2024-07-10T18:51:41.17828765+08:00 stdout F 2024-07-10T18:51:41.17829104+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|driver.py:init:442| When connecting to an existing cluster, num_cpus must not be provided. Num_cpus is neglected at this moment.2024-07-10T18:51:41.186607468+08:00 stdout F 2024-07-10 10:51:41,186|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock2024-07-10T18:51:41.187862675+08:00 stdout F 2024-07-10 10:51:41,186|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755920 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock2024-07-10T18:51:41.187876463+08:00 stdout F 2024-07-10 10:51:41,187|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock2024-07-10T18:51:41.187884371+08:00 stdout F 2024-07-10 10:51:41,187|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755920 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock2024-07-10T18:51:41.195553843+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755968 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195573688+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755968 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195581728+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755968 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195584401+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755968 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195586743+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755872 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195589549+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755872 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195591929+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755872 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195594945+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755872 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195604959+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979756064 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195607665+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979756064 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195610159+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979756064 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195612545+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979756064 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195614879+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195617116+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755920 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195619436+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195621757+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755920 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock2024-07-10T18:51:41.195558636+08:00 stderr F 2024-07-10 10:51:41,193 INFO worker.py:1724 -- Connected to Ray cluster.2024-07-10T18:51:41.87762114+08:00 stderr F 2024-07-10 10:51:41.877 INFO api.py:233 [p169] -- [Anonymous_job] Started rayfed with {'CLUSTER_ADDRESSES': {'p169': '0.0.0.0:31474', 'p170': 'http://jaf4vv5bhka06ugr-0-fed.p170.svc:80'}, 'CURRENT_PARTY_NAME': 'p169', 'TLS_CONFIG': {}}2024-07-10T18:51:42.464577392+08:00 stderr F �[33m(raylet)�[0m [2024-07-10 10:51:42,374 I 322 322] logging.cc:230: Set ray log level from environment variable RAY_BACKEND_LOG_LEVEL to -12024-07-10T18:51:43.072568636+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m 2024-07-10 10:51:42.971 INFO link.py:38 [p169] -- [Anonymous_job] brpc options: {'proxy_max_restarts': 3, 'timeout_in_ms': 300000, 'recv_timeout_ms': 604800000, 'connect_retry_times': 3600, 'connect_retry_interval_ms': 1000, 'brpc_channel_protocol': 'http', 'brpc_channel_connection_type': 'pooled', 'exit_on_sending_failure': True}2024-07-10T18:51:43.07260019+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m I0710 10:51:42.983831 322 external/com_github_brpc_brpc/src/brpc/server.cpp:1181] Server[yacl::link::transport::internal::ReceiverServiceImpl] is serving on port=31474.2024-07-10T18:51:43.072604097+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m W0710 10:51:42.983860 322 external/com_github_brpc_brpc/src/brpc/server.cpp:1187] Builtin services are disabled according to ServerOptions.has_builtin_services2024-07-10T18:51:44.058144081+08:00 stderr F 2024-07-10 10:51:44.057 INFO barriers.py:465 [p169] -- [Anonymous_job] Succeeded to create receiver proxy actor.2024-07-10T18:51:44.058182269+08:00 stderr F 2024-07-10 10:51:44.058 INFO barriers.py:520 [p169] -- [Anonymous_job] Try ping ['p170'] at 0 attemp, up to 3600 attemps.2024-07-10T18:51:44.067187907+08:00 stderr F 2024-07-10 10:51:44.066 INFO data_utils.py:391 [p169] -- [Anonymous_job] try load VDataFrame, file uri {'p169': DistdataInfo(uri='jobs/202407101638466494640/e1449345-psi-dataset', format='csv'), 'p170': DistdataInfo(uri='jobs/202407101638466494640/e1449345-psi-dataset', format='csv')}, file meta {}2024-07-10T18:51:44.06809435+08:00 stderr F 2024-07-10 10:51:44.067 ERROR component.py:1129 [p169] -- [Anonymous_job] eval on domain: "preprocessing"2024-07-10T18:51:44.068115884+08:00 stderr F name: "onehot_encode"2024-07-10T18:51:44.068121081+08:00 stderr F version: "0.0.3"2024-07-10T18:51:44.068125458+08:00 stderr F attr_paths: "input/input_data/feature_selects"2024-07-10T18:51:44.068129318+08:00 stderr F attr_paths: "drop"2024-07-10T18:51:44.068133575+08:00 stderr F attr_paths: "min_frequency"2024-07-10T18:51:44.068144438+08:00 stderr F attr_paths: "report_rules"2024-07-10T18:51:44.06814902+08:00 stderr F attrs {2024-07-10T18:51:44.068153054+08:00 stderr F ss: "kasieg_11"2024-07-10T18:51:44.068156406+08:00 stderr F ss: "kasieg_12"2024-07-10T18:51:44.068159057+08:00 stderr F ss: "kasieg_13"2024-07-10T18:51:44.068161799+08:00 stderr F ss: "kasieg_14"2024-07-10T18:51:44.068164483+08:00 stderr F ss: "kasieg_15"2024-07-10T18:51:44.068167084+08:00 stderr F ss: "kasieg_16"2024-07-10T18:51:44.06816972+08:00 stderr F ss: "kasieg_17"2024-07-10T18:51:44.068172482+08:00 stderr F ss: "kasieg_18"2024-07-10T18:51:44.06817514+08:00 stderr F ss: "kasieg_19"2024-07-10T18:51:44.068177768+08:00 stderr F ss: "kasieg_20"2024-07-10T18:51:44.06818072+08:00 stderr F ss: "kasieg_1"2024-07-10T18:51:44.068184605+08:00 stderr F ss: "kasieg_2"2024-07-10T18:51:44.068188327+08:00 stderr F ss: "kasieg_3"2024-07-10T18:51:44.0681923+08:00 stderr F ss: "kasieg_4"2024-07-10T18:51:44.06819607+08:00 stderr F ss: "kasieg_5"2024-07-10T18:51:44.068199888+08:00 stderr F ss: "kasieg_6"2024-07-10T18:51:44.068203383+08:00 stderr F ss: "kasieg_7"2024-07-10T18:51:44.068206815+08:00 stderr F ss: "kasieg_8"2024-07-10T18:51:44.068210343+08:00 stderr F ss: "kasieg_9"2024-07-10T18:51:44.068214068+08:00 stderr F ss: "kasieg_10"2024-07-10T18:51:44.068217837+08:00 stderr F }2024-07-10T18:51:44.068221929+08:00 stderr F attrs {2024-07-10T18:51:44.068225718+08:00 stderr F s: "no_drop"2024-07-10T18:51:44.068228453+08:00 stderr F }2024-07-10T18:51:44.068231129+08:00 stderr F attrs {2024-07-10T18:51:44.0682338+08:00 stderr F }2024-07-10T18:51:44.068236545+08:00 stderr F attrs {2024-07-10T18:51:44.068239386+08:00 stderr F b: true2024-07-10T18:51:44.068242011+08:00 stderr F }2024-07-10T18:51:44.068244731+08:00 stderr F inputs {2024-07-10T18:51:44.068247831+08:00 stderr F name: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:44.068250895+08:00 stderr F type: "sf.table.vertical_table"2024-07-10T18:51:44.068253654+08:00 stderr F system_info {2024-07-10T18:51:44.068256373+08:00 stderr F }2024-07-10T18:51:44.068259189+08:00 stderr F meta {2024-07-10T18:51:44.068262228+08:00 stderr F type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"2024-07-10T18:51:44.06826548+08:00 stderr F value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"2024-07-10T18:51:44.068268713+08:00 stderr F }2024-07-10T18:51:44.068271474+08:00 stderr F data_refs {2024-07-10T18:51:44.068274285+08:00 stderr F uri: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:44.068277201+08:00 stderr F party: "p169"2024-07-10T18:51:44.068279926+08:00 stderr F format: "csv"2024-07-10T18:51:44.068282763+08:00 stderr F }2024-07-10T18:51:44.068285577+08:00 stderr F data_refs {2024-07-10T18:51:44.068288291+08:00 stderr F uri: "jobs/202407101638466494640/e1449345-psi-dataset"2024-07-10T18:51:44.068291017+08:00 stderr F party: "p170"2024-07-10T18:51:44.068293783+08:00 stderr F format: "csv"2024-07-10T18:51:44.06830028+08:00 stderr F }2024-07-10T18:51:44.068303329+08:00 stderr F }2024-07-10T18:51:44.068306107+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-output_dataset"2024-07-10T18:51:44.06830891+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-onehot_rules"2024-07-10T18:51:44.068311652+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-report"2024-07-10T18:51:44.068314456+08:00 stderr F failed, error <Partitions in the VDataFrame is None or empty.>2024-07-10T18:51:44.06836261+08:00 stderr F 2024-07-10 10:51:44.068 INFO api.py:342 [p169] -- [Anonymous_job] Shutdowning rayfed intendedly...2024-07-10T18:51:44.068369073+08:00 stderr F 2024-07-10 10:51:44.068 INFO api.py:356 [p169] -- [Anonymous_job] No wait for data sending.2024-07-10T18:51:44.070183536+08:00 stderr F 2024-07-10 10:51:44.070 INFO message_queue.py:72 [p169] -- [Anonymous_job] Notify message polling thread[DataSendingQueueThread] to exit.2024-07-10T18:51:44.070231381+08:00 stderr F 2024-07-10 10:51:44.070 INFO message_queue.py:72 [p169] -- [Anonymous_job] Notify message polling thread[ErrorSendingQueueThread] to exit.2024-07-10T18:51:44.070270261+08:00 stderr F 2024-07-10 10:51:44.070 INFO api.py:384 [p169] -- [Anonymous_job] Shutdowned rayfed.2024-07-10T18:51:44.08478203+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m I0710 10:51:44.016073 366 external/com_github_brpc_brpc/src/brpc/span.cpp:506] Opened ./rpc_data/rpcz/20240710.105144.322/id.db and ./rpc_data/rpcz/20240710.105144.322/time.db2024-07-10T18:51:44.736633935+08:00 stderr F Traceback (most recent call last):2024-07-10T18:51:44.736657866+08:00 stderr F File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main2024-07-10T18:51:44.736661583+08:00 stderr F return _run_code(code, main_globals, None,2024-07-10T18:51:44.736664108+08:00 stderr F File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code2024-07-10T18:51:44.736667094+08:00 stderr F exec(code, run_globals)2024-07-10T18:51:44.736669754+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 547, in <module>2024-07-10T18:51:44.736672472+08:00 stderr F main()2024-07-10T18:51:44.736675145+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__2024-07-10T18:51:44.736677753+08:00 stderr F return self.main(*args, **kwargs)2024-07-10T18:51:44.736680107+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main2024-07-10T18:51:44.736682456+08:00 stderr F rv = self.invoke(ctx)2024-07-10T18:51:44.736684755+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke2024-07-10T18:51:44.736687172+08:00 stderr F return ctx.invoke(self.callback, **ctx.params)2024-07-10T18:51:44.736689455+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke2024-07-10T18:51:44.736691726+08:00 stderr F return __callback(*args, **kwargs)2024-07-10T18:51:44.736693941+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 527, in main2024-07-10T18:51:44.736696245+08:00 stderr F res = comp_eval(sf_node_eval_param, storage_config, sf_cluster_config)2024-07-10T18:51:44.736698758+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/entry.py", line 166, in comp_eval2024-07-10T18:51:44.736701413+08:00 stderr F res = comp.eval(2024-07-10T18:51:44.736703705+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1131, in eval2024-07-10T18:51:44.736706245+08:00 stderr F raise e from None2024-07-10T18:51:44.736708653+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1126, in eval2024-07-10T18:51:44.736710949+08:00 stderr F ret = self.__eval_callback(ctx=ctx, **kwargs)2024-07-10T18:51:44.736713836+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/unified_single_party_ops/onehot_encode.py", line 224, in onehot_encode_eval_fn2024-07-10T18:51:44.736723863+08:00 stderr F (output_dd, model_dd, dist_rules_obj) = v_preprocessing_transform(2024-07-10T18:51:44.736726692+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/core/table_utils.py", line 60, in v_preprocessing_transform2024-07-10T18:51:44.736729162+08:00 stderr F trans, remains = load_table_select_and_exclude_pair(2024-07-10T18:51:44.736731414+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/data_utils.py", line 418, in load_table_select_and_exclude_pair2024-07-10T18:51:44.736733605+08:00 stderr F trans_x = load_table(2024-07-10T18:51:44.736735979+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/component/data_utils.py", line 396, in load_table2024-07-10T18:51:44.736738245+08:00 stderr F shape = vdf.shape2024-07-10T18:51:44.736740478+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/data/vertical/dataframe.py", line 217, in shape2024-07-10T18:51:44.736742757+08:00 stderr F self._check_parts()2024-07-10T18:51:44.736744981+08:00 stderr F File "/usr/local/lib/python3.10/site-packages/secretflow/data/vertical/dataframe.py", line 86, in _check_parts2024-07-10T18:51:44.736747322+08:00 stderr F assert self.partitions, 'Partitions in the VDataFrame is None or empty.'2024-07-10T18:51:44.736749563+08:00 stderr F AssertionError: Partitions in the VDataFrame is None or empty.
The text was updated successfully, but these errors were encountered:
Issue Type
Running
Search for existing issues similar to yours
Yes
OS Platform and Distribution
Linux 20.04.1-Ubuntu
Kuscia Version
kuscia 0.8.0b0
Deployment
docker
deployment Version
Docker version 24.0.5
App Running type
secretflow
App Running version
secretflow 1.6.1b0
Configuration file used to run kuscia.
What happend and What you expected to happen.
Kuscia log output.
The text was updated successfully, but these errors were encountered: