Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

onehot_encode失败 #374

Open
T-ze-yu opened this issue Jul 10, 2024 · 3 comments
Open

onehot_encode失败 #374

T-ze-yu opened this issue Jul 10, 2024 · 3 comments
Labels
no-issue-activity

Comments

@T-ze-yu
Copy link

T-ze-yu commented Jul 10, 2024

Issue Type

Running

Search for existing issues similar to yours

Yes

OS Platform and Distribution

Linux 20.04.1-Ubuntu

Kuscia Version

kuscia 0.8.0b0

Deployment

docker

deployment Version

Docker version 24.0.5

App Running type

secretflow

App Running version

secretflow 1.6.1b0

Configuration file used to run kuscia.

mode: autonomy
domainID: p169
domainKeyData: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFcEFJQkFBS0NBUUVBNmRHSEkwcmM5ZHR5T2FlQnlsb3dNRkpTYW84ZWFkSThVWXVVNFF1WG53MlFkVmJ2ClRGVE1LR2NKeWozemMrbUdIR0p0RG9MTnlQN0dFVFd2cW1iZGpjMGxyOVBNcFRRWVhtN1RUSFEzcVpNZERyMUcKeDNQdkhGcjNQMlVYbjhhNUh2Y1VGYzFaa2w2R1pwVm5zNWpKdkY0YzgvYVpYNjUrZnBJS3cvclNKT2ZZV1k3bgpKckF4M3dzQUJsbllzMG10U0lqMXEzdW9tRWRCQTVrSk9HQ285TnR0LzNJeE12N3F2b2VvNFdKWldxTCtTcmM0CkpHRDRpQ2ZIZVVnb3p3d0NXUklaZGdyOGtZd2xFb0lnYUpUdkk4aWZxK1ZkaXNNeTZOOGlXSmxpQXVBSkp5RFYKdVJ4ZVBqeUEyaU1tbER4Ny91aXZwaFc3ZW42cjBmR3QyZ1NWelFJREFRQUJBb0lCQUNGMVRDTXV1VU90TFVFMgp5UW5Oc2d1WUhCY0hkOUNvdHR6c1hsZDlzeXFkWkVpR01pUDRGbWJKcDhyNjVuVjF1eTBnb0g1dEZVbG51NndHCnhLWmJwZVIrc0ovaWJPeE84aFhCUWhjMG9pcHYxTDZoTXhtamExbmhZblA5NFUySndEL0FGMjJ2UHR3RkRySnIKT3JXbWJXZTVCK2VaS0FWYkVOckh4eWFZSTY0SUFSWTNKYTdPTFA2N1VWSExZUElEV0RPRlppSVdKRjFBblZuMwowMWVpUitJMFZFaHBDZlA3ZTNpSWlETFFWT3diWno3bnFDbVhIeUd3aW1BWTdpWms3VzRaejhWdkVpRTFhMUxFCnRsbjFsSjkwYlpGVmo3dnJlU3EraW51M3gwMzA5YTNXOWhpSTZmZ0czMm84dnpTR1UwTmhHem8zN3pEU0N0d1QKTnRmZi9ya0NnWUVBOWZ6ckwvbVNSek82U3NLL3B5TnNkNGM5R3FpTnA1TGNCcWUreURzbWlrODg2dklDWXE2ZApZVTJ1aG1pbkV0Z1ZYcDlSVUVkUjF2b1k2VU41Y1hJellxc0FIZSt5VjgwNm8yTmhyNExaZjI1UDBYLzYzZHh4CldCeWhESXZKaUNhVjk0MC9BMThsanJiQ1MvOEFOVHA2ZktybFc1Mm03aGNjWmYrdzg5VjZLUE1DZ1lFQTgxWFAKQTBpL0NOWUFMWUltYmlBWk5IbkpZWDYrNEIzTDVwZkVSVU1zczhvalZKSTdmbk9pcjBaN1Vha0l6d3JReTFaNgpFN2w3YmZlTDFnN1lVWUZYWm05NE1JRGRHdWVaZ1FZWTBsVXFDQnk5RTYyMjBtaG5jZW5KYjFTSHM3U0pUUHJGCnRPSW5PVE44WjlGMzlyaU1qY2JmWXpxaEdlazRJaXJBTHRLNTlqOENnWUFJQmxvOTFHeDdPaXJIcVpiTEF4TFUKeTJxbzVmckpEcmR5MkNJWE1pYk51RXdLZGg2eHpYU0E2aUhaYkt5V3Bzbjdya0xlMVpUTDZKakxjMUlRNjJMVgp3ekpieDZnUHlUZ3lnRmw5ZWsxU0pPMGhyb1VtbTd4dTNYQTdrb3ZlanpPeFFjQmVnY29kMzhSeTZqeTlmOHpqCktFZ1hOd3R0RlAvdUsrcy82U1QxRlFLQmdRRHkzUmZxVFRidG1MbEFzbitzdGppeDJVT1hIU3RoQUJ3OElBbHkKbjZNRUpxR3dqT3I0UUcyRXhySGFSUDFYdDVIQkFLU0MvME1qOUVnSzgzSVBseW9tUU9jU2NlczhLUjlhV1QxNAo0Q3M5UVlHdEhGbzJFcUg4WGJ3QWM3dWxMbkZDOVo5Ujg4MzJGMTc1TjJXbVIzZHhJYVpmb1dxZE05b2tyOHAwCmNUbk5mUUtCZ1FEUHVjc2tmQmNRQ1hQZ0toOTBqa2E3b3E2SmtJcGZ4WE1KN1hKakw5NS8xNkRndFh2bSs4M3UKMWpjczBINzFsbGtQMS9WRjBWM1VPaDVrUDB4cHlqTnZLTVBTYXY2TVB2ckdad0NvY1dRelhJcG9aelJaNmxlMgpwMVB4NzVKMHNhZEFsc1VQZEJBRVZhOFFJVkxKU2R0K0N2by9udzl0ajljQm1EZjA2U0NPelE9PQotLS0tLUVORCBSU0EgUFJJVkFURSBLRVktLS0tLQo=
logLevel: INFO
runtime: runc
runk:
  namespace: ""
  dnsServers: []
  kubeconfigFile: ""
capacity:
  cpu: ""
  memory: ""
  pods: ""
  storage: ""
image:
  pullPolicy: ""
  defaultRegistry: ""
  registries: []
datastoreEndpoint: ""

What happend and What you expected to happen.

/job/create请求参数如下：
{'job_id': 'aqaecyndy8vhi75p', 'initiator': 'p169', 'max_parallelism': 1, 'tasks': [{'app_image': 'secretflow-image', 'parties': [{'domain_id': 'p169'}, {'domain_id': 'p170'}], 'alias': 'OnehotEncode', 'task_id': 'jaf4vv5bhka06ugr', 'task_input_config': '{"sf_datasource_config": {"p169": {"id": "default-data-source"}, "p170": {"id": "default-data-source"}}, "sf_cluster_desc": {"parties": ["p169", "p170"], "devices": [{"name": "spu", "type": "spu", "parties": ["p169", "p170"], "config": "{\\"runtime_config\\":{\\"protocol\\":\\"REF2K\\",\\"field\\":\\"FM64\\"},\\"link_desc\\":{\\"connect_retry_times\\":60,\\"connect_retry_interval_ms\\":1000,\\"brpc_channel_protocol\\":\\"http\\",\\"brpc_channel_connection_type\\":\\"pooled\\",\\"recv_timeout_ms\\":1200000,\\"http_timeout_ms\\":1200000}}"}, {"name": "heu", "type": "heu", "parties": ["p169", "p170"], "config": "{\\"mode\\": \\"PHEU\\", \\"schema\\": \\"paillier\\", \\"key_size\\": 2048}"}], "ray_fed_config": {"cross_silo_comm_backend": "brpc_link"}}, "sf_node_eval_param": {"domain": "preprocessing", "name": "onehot_encode", "version": "0.0.3", "attr_paths": ["input/input_data/feature_selects", "drop", "min_frequency", "report_rules"], "attrs": [{"ss": ["kasieg_11", "kasieg_12", "kasieg_13", "kasieg_14", "kasieg_15", "kasieg_16", "kasieg_17", "kasieg_18", "kasieg_19", "kasieg_20", "kasieg_1", "kasieg_2", "kasieg_3", "kasieg_4", "kasieg_5", "kasieg_6", "kasieg_7", "kasieg_8", "kasieg_9", "kasieg_10"]}, {"s": "no_drop"}, {"f": 0}, {"b": true}]}, "sf_input_ids": ["e1449345-psi-dataset"], "sf_output_ids": ["95bd2be9-output_dataset", "95bd2be9-onehot_rules", "95bd2be9-report"], "sf_output_uris": ["jobs/202407101638466494640/95bd2be9-output_dataset", "jobs/202407101638466494640/95bd2be9-onehot_rules", "jobs/202407101638466494640/95bd2be9-report"]}', 'priority': '100'}, {'app_image': 'secretflow-image', 'parties': [{'domain_id': 'p169'}, {'domain_id': 'p170'}], 'alias': 'Substitution', 'task_id': 'f2pw3ctyedox29h2', 'task_input_config': '{"sf_datasource_config": {"p169": {"id": "default-data-source"}, "p170": {"id": "default-data-source"}}, "sf_cluster_desc": {"parties": ["p169", "p170"], "devices": [{"name": "spu", "type": "spu", "parties": ["p169", "p170"], "config": "{\\"runtime_config\\":{\\"protocol\\":\\"REF2K\\",\\"field\\":\\"FM64\\"},\\"link_desc\\":{\\"connect_retry_times\\":60,\\"connect_retry_interval_ms\\":1000,\\"brpc_channel_protocol\\":\\"http\\",\\"brpc_channel_connection_type\\":\\"pooled\\",\\"recv_timeout_ms\\":1200000,\\"http_timeout_ms\\":1200000}}"}, {"name": "heu", "type": "heu", "parties": ["p169", "p170"], "config": "{\\"mode\\": \\"PHEU\\", \\"schema\\": \\"paillier\\", \\"key_size\\": 2048}"}], "ray_fed_config": {"cross_silo_comm_backend": "brpc_link"}}, "sf_node_eval_param": {"domain": "preprocessing", "name": "substitution", "version": "0.0.2", "attr_paths": [], "attrs": []}, "sf_input_ids": ["95bd2be9-output_dataset", "e1449345-psi-dataset"], "sf_output_ids": ["95bd2be9-substitution-dataset"], "sf_output_uris": ["jobs/202407101638466494640/95bd2be9-substitution-dataset"]}', 'priority': '100'}]}
希望onehot_encode运行成功

Kuscia log output.

2024-07-10T18:51:37.724884316+08:00 stderr F WARNING:root:Since the GPL-licensed package `unidecode` is not installed, using Python's `unicodedata` package which yields worse results.
2024-07-10T18:51:38.433441838+08:00 stdout F 2024-07-10 10:51:38,432|p169|INFO|secretflow|entry.py:start_ray:59| ray_conf: RayConfig(ray_node_ip_address='jaf4vv5bhka06ugr-0-global.p169.svc', ray_node_manager_port=31470, ray_object_manager_port=31471, ray_client_server_port=31472, ray_worker_ports=[], ray_gcs_port=31475)
2024-07-10T18:51:38.433516254+08:00 stdout F 2024-07-10 10:51:38,432|p169|INFO|secretflow|entry.py:start_ray:63| Trying to start ray head node at jaf4vv5bhka06ugr-0-global.p169.svc, start command: RAY_BACKEND_LOG_LEVEL=debug RAY_grpc_enable_http_proxy=true OMP_NUM_THREADS=4 ray start --head --include-dashboard=false --disable-usage-stats --num-cpus=32 --node-ip-address=jaf4vv5bhka06ugr-0-global.p169.svc --port=31475 --node-manager-port=31470 --object-manager-port=31471 --ray-client-server-port=31472
2024-07-10T18:51:41.15345814+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:start_ray:80| 2024-07-10 10:51:39,041	INFO usage_lib.py:423 -- Usage stats collection is disabled.
2024-07-10T18:51:41.153477371+08:00 stdout F 2024-07-10 10:51:39,041	INFO scripts.py:744 -- Local node IP: jaf4vv5bhka06ugr-0-global.p169.svc
2024-07-10T18:51:41.153481538+08:00 stdout F 2024-07-10 10:51:40,988	SUCC scripts.py:781 -- --------------------
2024-07-10T18:51:41.153483986+08:00 stdout F 2024-07-10 10:51:40,988	SUCC scripts.py:782 -- Ray runtime started.
2024-07-10T18:51:41.153497457+08:00 stdout F 2024-07-10 10:51:40,988	SUCC scripts.py:783 -- --------------------
2024-07-10T18:51:41.153501952+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:785 -- Next steps
2024-07-10T18:51:41.153504316+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:788 -- To add another node to this Ray cluster, run
2024-07-10T18:51:41.153507589+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:791 --   ray start --address='jaf4vv5bhka06ugr-0-global.p169.svc:31475'
2024-07-10T18:51:41.153510028+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:800 -- To connect to this Ray cluster:
2024-07-10T18:51:41.153512303+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:802 -- import ray
2024-07-10T18:51:41.153515033+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:803 -- ray.init(_node_ip_address='jaf4vv5bhka06ugr-0-global.p169.svc')
2024-07-10T18:51:41.153517318+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:834 -- To terminate the Ray runtime, run
2024-07-10T18:51:41.153519517+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:835 --   ray stop
2024-07-10T18:51:41.153521858+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:838 -- To view the status of the cluster, use
2024-07-10T18:51:41.153524081+08:00 stdout F 2024-07-10 10:51:40,989	INFO scripts.py:839 --   ray status
2024-07-10T18:51:41.153526177+08:00 stdout F 
2024-07-10T18:51:41.1535295+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:start_ray:81| Succeeded to start ray head node at jaf4vv5bhka06ugr-0-global.p169.svc.
2024-07-10T18:51:41.153531965+08:00 stdout F 2024-07-10 10:51:41,152|p169|INFO|secretflow|entry.py:main:510| datasource.access_directly True
2024-07-10T18:51:41.153534623+08:00 stdout F sf_node_eval_param  {
2024-07-10T18:51:41.153538305+08:00 stdout F   "domain": "preprocessing",
2024-07-10T18:51:41.153540611+08:00 stdout F   "name": "onehot_encode",
2024-07-10T18:51:41.153542732+08:00 stdout F   "version": "0.0.3",
2024-07-10T18:51:41.153544997+08:00 stdout F   "attrPaths": [
2024-07-10T18:51:41.153548005+08:00 stdout F     "input/input_data/feature_selects",
2024-07-10T18:51:41.153550284+08:00 stdout F     "drop",
2024-07-10T18:51:41.153552543+08:00 stdout F     "min_frequency",
2024-07-10T18:51:41.153554718+08:00 stdout F     "report_rules"
2024-07-10T18:51:41.153556895+08:00 stdout F   ],
2024-07-10T18:51:41.153559177+08:00 stdout F   "attrs": [
2024-07-10T18:51:41.153561378+08:00 stdout F     {
2024-07-10T18:51:41.153563605+08:00 stdout F       "ss": [
2024-07-10T18:51:41.153574194+08:00 stdout F         "kasieg_11",
2024-07-10T18:51:41.153576697+08:00 stdout F         "kasieg_12",
2024-07-10T18:51:41.153579226+08:00 stdout F         "kasieg_13",
2024-07-10T18:51:41.153581407+08:00 stdout F         "kasieg_14",
2024-07-10T18:51:41.153583572+08:00 stdout F         "kasieg_15",
2024-07-10T18:51:41.153585931+08:00 stdout F         "kasieg_16",
2024-07-10T18:51:41.153588175+08:00 stdout F         "kasieg_17",
2024-07-10T18:51:41.153590369+08:00 stdout F         "kasieg_18",
2024-07-10T18:51:41.153592505+08:00 stdout F         "kasieg_19",
2024-07-10T18:51:41.153594693+08:00 stdout F         "kasieg_20",
2024-07-10T18:51:41.15359693+08:00 stdout F         "kasieg_1",
2024-07-10T18:51:41.153599102+08:00 stdout F         "kasieg_2",
2024-07-10T18:51:41.153601586+08:00 stdout F         "kasieg_3",
2024-07-10T18:51:41.153603755+08:00 stdout F         "kasieg_4",
2024-07-10T18:51:41.15360596+08:00 stdout F         "kasieg_5",
2024-07-10T18:51:41.153608194+08:00 stdout F         "kasieg_6",
2024-07-10T18:51:41.15361041+08:00 stdout F         "kasieg_7",
2024-07-10T18:51:41.153612577+08:00 stdout F         "kasieg_8",
2024-07-10T18:51:41.153614839+08:00 stdout F         "kasieg_9",
2024-07-10T18:51:41.153617046+08:00 stdout F         "kasieg_10"
2024-07-10T18:51:41.15361919+08:00 stdout F       ]
2024-07-10T18:51:41.153621487+08:00 stdout F     },
2024-07-10T18:51:41.153829208+08:00 stdout F     {
2024-07-10T18:51:41.153833217+08:00 stdout F       "s": "no_drop"
2024-07-10T18:51:41.153835534+08:00 stdout F     },
2024-07-10T18:51:41.153837923+08:00 stdout F     {},
2024-07-10T18:51:41.153840178+08:00 stdout F     {
2024-07-10T18:51:41.153842462+08:00 stdout F       "b": true
2024-07-10T18:51:41.153844749+08:00 stdout F     }
2024-07-10T18:51:41.153847004+08:00 stdout F   ]
2024-07-10T18:51:41.153849383+08:00 stdout F } 
2024-07-10T18:51:41.17003918+08:00 stdout F 2024-07-10 10:51:41,169|p169|INFO|secretflow|entry.py:domaindata_id_to_dist_data:160| domaindata_id e1449345-psi-dataset to 
2024-07-10T18:51:41.170070859+08:00 stdout F ...........
2024-07-10T18:51:41.170077362+08:00 stdout F name: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.170082447+08:00 stdout F type: "sf.table.vertical_table"
2024-07-10T18:51:41.170086295+08:00 stdout F system_info {
2024-07-10T18:51:41.17009023+08:00 stdout F }
2024-07-10T18:51:41.170094095+08:00 stdout F meta {
2024-07-10T18:51:41.170099545+08:00 stdout F   type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-07-10T18:51:41.170104605+08:00 stdout F   value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"
2024-07-10T18:51:41.170108688+08:00 stdout F }
2024-07-10T18:51:41.170112475+08:00 stdout F data_refs {
2024-07-10T18:51:41.170116408+08:00 stdout F   uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.170120444+08:00 stdout F   party: "p169"
2024-07-10T18:51:41.170124245+08:00 stdout F   format: "csv"
2024-07-10T18:51:41.170127931+08:00 stdout F }
2024-07-10T18:51:41.170131918+08:00 stdout F data_refs {
2024-07-10T18:51:41.170135657+08:00 stdout F   uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.17013939+08:00 stdout F   party: "p170"
2024-07-10T18:51:41.170143316+08:00 stdout F   format: "csv"
2024-07-10T18:51:41.170147011+08:00 stdout F }
2024-07-10T18:51:41.170150546+08:00 stdout F 
2024-07-10T18:51:41.170154319+08:00 stdout F ....
2024-07-10T18:51:41.177938203+08:00 stderr F 2024-07-10 10:51:41,171	INFO worker.py:1540 -- Connecting to existing Ray cluster at address: jaf4vv5bhka06ugr-0-global.p169.svc:31475...
2024-07-10T18:51:41.177981066+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:159| 
2024-07-10T18:51:41.177985316+08:00 stdout F --
2024-07-10T18:51:41.177988497+08:00 stdout F Secretflow 1.6.1b0
2024-07-10T18:51:41.177992137+08:00 stdout F Build time (May 27 2024, 04:48:06) with commit id: eac355f390d9d0d7276ee4cea8d1fe38417cabb6
2024-07-10T18:51:41.177994425+08:00 stdout F --
2024-07-10T18:51:41.177996533+08:00 stdout F 
2024-07-10T18:51:41.177998842+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:160| 
2024-07-10T18:51:41.178001479+08:00 stdout F --
2024-07-10T18:51:41.17800402+08:00 stdout F *param* 
2024-07-10T18:51:41.17800615+08:00 stdout F 
2024-07-10T18:51:41.178008439+08:00 stdout F domain: "preprocessing"
2024-07-10T18:51:41.178010676+08:00 stdout F name: "onehot_encode"
2024-07-10T18:51:41.178012965+08:00 stdout F version: "0.0.3"
2024-07-10T18:51:41.178016124+08:00 stdout F attr_paths: "input/input_data/feature_selects"
2024-07-10T18:51:41.178018376+08:00 stdout F attr_paths: "drop"
2024-07-10T18:51:41.178021519+08:00 stdout F attr_paths: "min_frequency"
2024-07-10T18:51:41.178023784+08:00 stdout F attr_paths: "report_rules"
2024-07-10T18:51:41.178026047+08:00 stdout F attrs {
2024-07-10T18:51:41.178028388+08:00 stdout F   ss: "kasieg_11"
2024-07-10T18:51:41.178030749+08:00 stdout F   ss: "kasieg_12"
2024-07-10T18:51:41.178033125+08:00 stdout F   ss: "kasieg_13"
2024-07-10T18:51:41.17803539+08:00 stdout F   ss: "kasieg_14"
2024-07-10T18:51:41.178037599+08:00 stdout F   ss: "kasieg_15"
2024-07-10T18:51:41.178039848+08:00 stdout F   ss: "kasieg_16"
2024-07-10T18:51:41.178042168+08:00 stdout F   ss: "kasieg_17"
2024-07-10T18:51:41.17804444+08:00 stdout F   ss: "kasieg_18"
2024-07-10T18:51:41.178047121+08:00 stdout F   ss: "kasieg_19"
2024-07-10T18:51:41.178049936+08:00 stdout F   ss: "kasieg_20"
2024-07-10T18:51:41.178052289+08:00 stdout F   ss: "kasieg_1"
2024-07-10T18:51:41.178054545+08:00 stdout F   ss: "kasieg_2"
2024-07-10T18:51:41.178056769+08:00 stdout F   ss: "kasieg_3"
2024-07-10T18:51:41.178058913+08:00 stdout F   ss: "kasieg_4"
2024-07-10T18:51:41.178061099+08:00 stdout F   ss: "kasieg_5"
2024-07-10T18:51:41.178063323+08:00 stdout F   ss: "kasieg_6"
2024-07-10T18:51:41.178065543+08:00 stdout F   ss: "kasieg_7"
2024-07-10T18:51:41.178067663+08:00 stdout F   ss: "kasieg_8"
2024-07-10T18:51:41.178069871+08:00 stdout F   ss: "kasieg_9"
2024-07-10T18:51:41.178072064+08:00 stdout F   ss: "kasieg_10"
2024-07-10T18:51:41.178074271+08:00 stdout F }
2024-07-10T18:51:41.178076477+08:00 stdout F attrs {
2024-07-10T18:51:41.178078679+08:00 stdout F   s: "no_drop"
2024-07-10T18:51:41.178080871+08:00 stdout F }
2024-07-10T18:51:41.178083097+08:00 stdout F attrs {
2024-07-10T18:51:41.178085266+08:00 stdout F }
2024-07-10T18:51:41.178087432+08:00 stdout F attrs {
2024-07-10T18:51:41.178089668+08:00 stdout F   b: true
2024-07-10T18:51:41.178091828+08:00 stdout F }
2024-07-10T18:51:41.17809401+08:00 stdout F inputs {
2024-07-10T18:51:41.178097125+08:00 stdout F   name: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.178099477+08:00 stdout F   type: "sf.table.vertical_table"
2024-07-10T18:51:41.178101734+08:00 stdout F   system_info {
2024-07-10T18:51:41.178103919+08:00 stdout F   }
2024-07-10T18:51:41.178106085+08:00 stdout F   meta {
2024-07-10T18:51:41.178108341+08:00 stdout F     type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-07-10T18:51:41.178111548+08:00 stdout F     value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"
2024-07-10T18:51:41.178116342+08:00 stdout F   }
2024-07-10T18:51:41.178118701+08:00 stdout F   data_refs {
2024-07-10T18:51:41.178121025+08:00 stdout F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.178123334+08:00 stdout F     party: "p169"
2024-07-10T18:51:41.178125586+08:00 stdout F     format: "csv"
2024-07-10T18:51:41.178127763+08:00 stdout F   }
2024-07-10T18:51:41.178130003+08:00 stdout F   data_refs {
2024-07-10T18:51:41.178132267+08:00 stdout F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:41.178134486+08:00 stdout F     party: "p170"
2024-07-10T18:51:41.178136794+08:00 stdout F     format: "csv"
2024-07-10T18:51:41.178138971+08:00 stdout F   }
2024-07-10T18:51:41.178141188+08:00 stdout F }
2024-07-10T18:51:41.178143466+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-output_dataset"
2024-07-10T18:51:41.178145726+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-onehot_rules"
2024-07-10T18:51:41.178147956+08:00 stdout F output_uris: "jobs/202407101638466494640/95bd2be9-report"
2024-07-10T18:51:41.178149978+08:00 stdout F 
2024-07-10T18:51:41.178152211+08:00 stdout F --
2024-07-10T18:51:41.178154257+08:00 stdout F 
2024-07-10T18:51:41.178156509+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:161| 
2024-07-10T18:51:41.178158743+08:00 stdout F --
2024-07-10T18:51:41.178161007+08:00 stdout F *storage_config* 
2024-07-10T18:51:41.178163041+08:00 stdout F 
2024-07-10T18:51:41.178165195+08:00 stdout F type: "local_fs"
2024-07-10T18:51:41.178167411+08:00 stdout F local_fs {
2024-07-10T18:51:41.178169655+08:00 stdout F   wd: "/home/kuscia/var/storage/data"
2024-07-10T18:51:41.17817184+08:00 stdout F }
2024-07-10T18:51:41.17817391+08:00 stdout F 
2024-07-10T18:51:41.178176129+08:00 stdout F --
2024-07-10T18:51:41.178178187+08:00 stdout F 
2024-07-10T18:51:41.178180446+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|entry.py:comp_eval:162| 
2024-07-10T18:51:41.178182627+08:00 stdout F --
2024-07-10T18:51:41.178184807+08:00 stdout F *cluster_config* 
2024-07-10T18:51:41.178186822+08:00 stdout F 
2024-07-10T18:51:41.178189002+08:00 stdout F desc {
2024-07-10T18:51:41.178191204+08:00 stdout F   parties: "p169"
2024-07-10T18:51:41.17819347+08:00 stdout F   parties: "p170"
2024-07-10T18:51:41.17819613+08:00 stdout F   devices {
2024-07-10T18:51:41.178198353+08:00 stdout F     name: "spu"
2024-07-10T18:51:41.178200588+08:00 stdout F     type: "spu"
2024-07-10T18:51:41.178202789+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178205068+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.178208426+08:00 stdout F     config: "{\"runtime_config\":{\"protocol\":\"REF2K\",\"field\":\"FM64\"},\"link_desc\":{\"connect_retry_times\":60,\"connect_retry_interval_ms\":1000,\"brpc_channel_protocol\":\"http\",\"brpc_channel_connection_type\":\"pooled\",\"recv_timeout_ms\":1200000,\"http_timeout_ms\":1200000}}"
2024-07-10T18:51:41.178210682+08:00 stdout F   }
2024-07-10T18:51:41.178212975+08:00 stdout F   devices {
2024-07-10T18:51:41.178215198+08:00 stdout F     name: "heu"
2024-07-10T18:51:41.178217381+08:00 stdout F     type: "heu"
2024-07-10T18:51:41.178219952+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178222116+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.17822434+08:00 stdout F     config: "{\"mode\": \"PHEU\", \"schema\": \"paillier\", \"key_size\": 2048}"
2024-07-10T18:51:41.178226574+08:00 stdout F   }
2024-07-10T18:51:41.178228823+08:00 stdout F   ray_fed_config {
2024-07-10T18:51:41.178231104+08:00 stdout F     cross_silo_comm_backend: "brpc_link"
2024-07-10T18:51:41.178233298+08:00 stdout F   }
2024-07-10T18:51:41.178235463+08:00 stdout F }
2024-07-10T18:51:41.178239047+08:00 stdout F public_config {
2024-07-10T18:51:41.178241239+08:00 stdout F   ray_fed_config {
2024-07-10T18:51:41.178245492+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178247787+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.178250007+08:00 stdout F     addresses: "0.0.0.0:31474"
2024-07-10T18:51:41.17825229+08:00 stdout F     addresses: "jaf4vv5bhka06ugr-0-fed.p170.svc:80"
2024-07-10T18:51:41.178254504+08:00 stdout F   }
2024-07-10T18:51:41.178256682+08:00 stdout F   spu_configs {
2024-07-10T18:51:41.178258967+08:00 stdout F     name: "spu"
2024-07-10T18:51:41.178261153+08:00 stdout F     parties: "p169"
2024-07-10T18:51:41.178263379+08:00 stdout F     parties: "p170"
2024-07-10T18:51:41.178265609+08:00 stdout F     addresses: "0.0.0.0:31473"
2024-07-10T18:51:41.178267854+08:00 stdout F     addresses: "http://jaf4vv5bhka06ugr-0-spu.p170.svc:80"
2024-07-10T18:51:41.178270083+08:00 stdout F   }
2024-07-10T18:51:41.178272532+08:00 stdout F }
2024-07-10T18:51:41.178274775+08:00 stdout F private_config {
2024-07-10T18:51:41.178276915+08:00 stdout F   self_party: "p169"
2024-07-10T18:51:41.178279139+08:00 stdout F   ray_head_addr: "jaf4vv5bhka06ugr-0-global.p169.svc:31475"
2024-07-10T18:51:41.178281387+08:00 stdout F }
2024-07-10T18:51:41.178283439+08:00 stdout F 
2024-07-10T18:51:41.178285559+08:00 stdout F --
2024-07-10T18:51:41.17828765+08:00 stdout F 
2024-07-10T18:51:41.17829104+08:00 stdout F 2024-07-10 10:51:41,170|p169|WARNING|secretflow|driver.py:init:442| When connecting to an existing cluster, num_cpus must not be provided. Num_cpus is neglected at this moment.
2024-07-10T18:51:41.186607468+08:00 stdout F 2024-07-10 10:51:41,186|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.187862675+08:00 stdout F 2024-07-10 10:51:41,186|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755920 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.187876463+08:00 stdout F 2024-07-10 10:51:41,187|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.187884371+08:00 stdout F 2024-07-10 10:51:41,187|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755920 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/node_ip_address.json.lock
2024-07-10T18:51:41.195553843+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755968 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195573688+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755968 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195581728+08:00 stdout F 2024-07-10 10:51:41,192|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755968 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195584401+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755968 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195586743+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755872 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195589549+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755872 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195591929+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755872 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195594945+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755872 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195604959+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979756064 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195607665+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979756064 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195610159+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979756064 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195612545+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979756064 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195614879+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:294| Attempting to acquire lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195617116+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:acquire:297| Lock 139746979755920 acquired on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195619436+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:327| Attempting to release lock 139746979755920 on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195621757+08:00 stdout F 2024-07-10 10:51:41,193|p169|DEBUG|secretflow|_api.py:release:330| Lock 139746979755920 released on /tmp/ray/session_2024-07-10_10-51-39_042013_30/ports_by_node.json.lock
2024-07-10T18:51:41.195558636+08:00 stderr F 2024-07-10 10:51:41,193	INFO worker.py:1724 -- Connected to Ray cluster.
2024-07-10T18:51:41.87762114+08:00 stderr F 2024-07-10 10:51:41.877 INFO api.py:233 [p169] -- [Anonymous_job] Started rayfed with {'CLUSTER_ADDRESSES': {'p169': '0.0.0.0:31474', 'p170': 'http://jaf4vv5bhka06ugr-0-fed.p170.svc:80'}, 'CURRENT_PARTY_NAME': 'p169', 'TLS_CONFIG': {}}
2024-07-10T18:51:42.464577392+08:00 stderr F �[33m(raylet)�[0m [2024-07-10 10:51:42,374 I 322 322] logging.cc:230: Set ray log level from environment variable RAY_BACKEND_LOG_LEVEL to -1
2024-07-10T18:51:43.072568636+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m 2024-07-10 10:51:42.971 INFO link.py:38 [p169] -- [Anonymous_job] brpc options: {'proxy_max_restarts': 3, 'timeout_in_ms': 300000, 'recv_timeout_ms': 604800000, 'connect_retry_times': 3600, 'connect_retry_interval_ms': 1000, 'brpc_channel_protocol': 'http', 'brpc_channel_connection_type': 'pooled', 'exit_on_sending_failure': True}
2024-07-10T18:51:43.07260019+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m I0710 10:51:42.983831   322 external/com_github_brpc_brpc/src/brpc/server.cpp:1181] Server[yacl::link::transport::internal::ReceiverServiceImpl] is serving on port=31474.
2024-07-10T18:51:43.072604097+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m W0710 10:51:42.983860   322 external/com_github_brpc_brpc/src/brpc/server.cpp:1187] Builtin services are disabled according to ServerOptions.has_builtin_services
2024-07-10T18:51:44.058144081+08:00 stderr F 2024-07-10 10:51:44.057 INFO barriers.py:465 [p169] -- [Anonymous_job] Succeeded to create receiver proxy actor.
2024-07-10T18:51:44.058182269+08:00 stderr F 2024-07-10 10:51:44.058 INFO barriers.py:520 [p169] -- [Anonymous_job] Try ping ['p170'] at 0 attemp, up to 3600 attemps.
2024-07-10T18:51:44.067187907+08:00 stderr F 2024-07-10 10:51:44.066 INFO data_utils.py:391 [p169] -- [Anonymous_job] try load VDataFrame, file uri {'p169': DistdataInfo(uri='jobs/202407101638466494640/e1449345-psi-dataset', format='csv'), 'p170': DistdataInfo(uri='jobs/202407101638466494640/e1449345-psi-dataset', format='csv')}, file meta {}
2024-07-10T18:51:44.06809435+08:00 stderr F 2024-07-10 10:51:44.067 ERROR component.py:1129 [p169] -- [Anonymous_job] eval on domain: "preprocessing"
2024-07-10T18:51:44.068115884+08:00 stderr F name: "onehot_encode"
2024-07-10T18:51:44.068121081+08:00 stderr F version: "0.0.3"
2024-07-10T18:51:44.068125458+08:00 stderr F attr_paths: "input/input_data/feature_selects"
2024-07-10T18:51:44.068129318+08:00 stderr F attr_paths: "drop"
2024-07-10T18:51:44.068133575+08:00 stderr F attr_paths: "min_frequency"
2024-07-10T18:51:44.068144438+08:00 stderr F attr_paths: "report_rules"
2024-07-10T18:51:44.06814902+08:00 stderr F attrs {
2024-07-10T18:51:44.068153054+08:00 stderr F   ss: "kasieg_11"
2024-07-10T18:51:44.068156406+08:00 stderr F   ss: "kasieg_12"
2024-07-10T18:51:44.068159057+08:00 stderr F   ss: "kasieg_13"
2024-07-10T18:51:44.068161799+08:00 stderr F   ss: "kasieg_14"
2024-07-10T18:51:44.068164483+08:00 stderr F   ss: "kasieg_15"
2024-07-10T18:51:44.068167084+08:00 stderr F   ss: "kasieg_16"
2024-07-10T18:51:44.06816972+08:00 stderr F   ss: "kasieg_17"
2024-07-10T18:51:44.068172482+08:00 stderr F   ss: "kasieg_18"
2024-07-10T18:51:44.06817514+08:00 stderr F   ss: "kasieg_19"
2024-07-10T18:51:44.068177768+08:00 stderr F   ss: "kasieg_20"
2024-07-10T18:51:44.06818072+08:00 stderr F   ss: "kasieg_1"
2024-07-10T18:51:44.068184605+08:00 stderr F   ss: "kasieg_2"
2024-07-10T18:51:44.068188327+08:00 stderr F   ss: "kasieg_3"
2024-07-10T18:51:44.0681923+08:00 stderr F   ss: "kasieg_4"
2024-07-10T18:51:44.06819607+08:00 stderr F   ss: "kasieg_5"
2024-07-10T18:51:44.068199888+08:00 stderr F   ss: "kasieg_6"
2024-07-10T18:51:44.068203383+08:00 stderr F   ss: "kasieg_7"
2024-07-10T18:51:44.068206815+08:00 stderr F   ss: "kasieg_8"
2024-07-10T18:51:44.068210343+08:00 stderr F   ss: "kasieg_9"
2024-07-10T18:51:44.068214068+08:00 stderr F   ss: "kasieg_10"
2024-07-10T18:51:44.068217837+08:00 stderr F }
2024-07-10T18:51:44.068221929+08:00 stderr F attrs {
2024-07-10T18:51:44.068225718+08:00 stderr F   s: "no_drop"
2024-07-10T18:51:44.068228453+08:00 stderr F }
2024-07-10T18:51:44.068231129+08:00 stderr F attrs {
2024-07-10T18:51:44.0682338+08:00 stderr F }
2024-07-10T18:51:44.068236545+08:00 stderr F attrs {
2024-07-10T18:51:44.068239386+08:00 stderr F   b: true
2024-07-10T18:51:44.068242011+08:00 stderr F }
2024-07-10T18:51:44.068244731+08:00 stderr F inputs {
2024-07-10T18:51:44.068247831+08:00 stderr F   name: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:44.068250895+08:00 stderr F   type: "sf.table.vertical_table"
2024-07-10T18:51:44.068253654+08:00 stderr F   system_info {
2024-07-10T18:51:44.068256373+08:00 stderr F   }
2024-07-10T18:51:44.068259189+08:00 stderr F   meta {
2024-07-10T18:51:44.068262228+08:00 stderr F     type_url: "type.googleapis.com/secretflow.spec.v1.VerticalTable"
2024-07-10T18:51:44.06826548+08:00 stderr F     value: "\n\310\001\n\003id2\022\tkasieg_11\022\tkasieg_12\022\tkasieg_13\022\tkasieg_14\022\tkasieg_15\022\tkasieg_16\022\tkasieg_17\022\tkasieg_18\022\tkasieg_19\022\tkasieg_20\022\001y\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\n\265\001\n\003id1\022\010kasieg_1\022\010kasieg_2\022\010kasieg_3\022\010kasieg_4\022\010kasieg_5\022\010kasieg_6\022\010kasieg_7\022\010kasieg_8\022\010kasieg_9\022\tkasieg_10\"\003int*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float*\005float\020\350\007"
2024-07-10T18:51:44.068268713+08:00 stderr F   }
2024-07-10T18:51:44.068271474+08:00 stderr F   data_refs {
2024-07-10T18:51:44.068274285+08:00 stderr F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:44.068277201+08:00 stderr F     party: "p169"
2024-07-10T18:51:44.068279926+08:00 stderr F     format: "csv"
2024-07-10T18:51:44.068282763+08:00 stderr F   }
2024-07-10T18:51:44.068285577+08:00 stderr F   data_refs {
2024-07-10T18:51:44.068288291+08:00 stderr F     uri: "jobs/202407101638466494640/e1449345-psi-dataset"
2024-07-10T18:51:44.068291017+08:00 stderr F     party: "p170"
2024-07-10T18:51:44.068293783+08:00 stderr F     format: "csv"
2024-07-10T18:51:44.06830028+08:00 stderr F   }
2024-07-10T18:51:44.068303329+08:00 stderr F }
2024-07-10T18:51:44.068306107+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-output_dataset"
2024-07-10T18:51:44.06830891+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-onehot_rules"
2024-07-10T18:51:44.068311652+08:00 stderr F output_uris: "jobs/202407101638466494640/95bd2be9-report"
2024-07-10T18:51:44.068314456+08:00 stderr F  failed, error <Partitions in the VDataFrame is None or empty.>
2024-07-10T18:51:44.06836261+08:00 stderr F 2024-07-10 10:51:44.068 INFO api.py:342 [p169] -- [Anonymous_job] Shutdowning rayfed intendedly...
2024-07-10T18:51:44.068369073+08:00 stderr F 2024-07-10 10:51:44.068 INFO api.py:356 [p169] -- [Anonymous_job] No wait for data sending.
2024-07-10T18:51:44.070183536+08:00 stderr F 2024-07-10 10:51:44.070 INFO message_queue.py:72 [p169] -- [Anonymous_job] Notify message polling thread[DataSendingQueueThread] to exit.
2024-07-10T18:51:44.070231381+08:00 stderr F 2024-07-10 10:51:44.070 INFO message_queue.py:72 [p169] -- [Anonymous_job] Notify message polling thread[ErrorSendingQueueThread] to exit.
2024-07-10T18:51:44.070270261+08:00 stderr F 2024-07-10 10:51:44.070 INFO api.py:384 [p169] -- [Anonymous_job] Shutdowned rayfed.
2024-07-10T18:51:44.08478203+08:00 stderr F �[36m(SenderReceiverProxyActor pid=322)�[0m I0710 10:51:44.016073   366 external/com_github_brpc_brpc/src/brpc/span.cpp:506] Opened ./rpc_data/rpcz/20240710.105144.322/id.db and ./rpc_data/rpcz/20240710.105144.322/time.db
2024-07-10T18:51:44.736633935+08:00 stderr F Traceback (most recent call last):
2024-07-10T18:51:44.736657866+08:00 stderr F   File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-07-10T18:51:44.736661583+08:00 stderr F     return _run_code(code, main_globals, None,
2024-07-10T18:51:44.736664108+08:00 stderr F   File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-10T18:51:44.736667094+08:00 stderr F     exec(code, run_globals)
2024-07-10T18:51:44.736669754+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 547, in <module>
2024-07-10T18:51:44.736672472+08:00 stderr F     main()
2024-07-10T18:51:44.736675145+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
2024-07-10T18:51:44.736677753+08:00 stderr F     return self.main(*args, **kwargs)
2024-07-10T18:51:44.736680107+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main
2024-07-10T18:51:44.736682456+08:00 stderr F     rv = self.invoke(ctx)
2024-07-10T18:51:44.736684755+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
2024-07-10T18:51:44.736687172+08:00 stderr F     return ctx.invoke(self.callback, **ctx.params)
2024-07-10T18:51:44.736689455+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
2024-07-10T18:51:44.736691726+08:00 stderr F     return __callback(*args, **kwargs)
2024-07-10T18:51:44.736693941+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py", line 527, in main
2024-07-10T18:51:44.736696245+08:00 stderr F     res = comp_eval(sf_node_eval_param, storage_config, sf_cluster_config)
2024-07-10T18:51:44.736698758+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/entry.py", line 166, in comp_eval
2024-07-10T18:51:44.736701413+08:00 stderr F     res = comp.eval(
2024-07-10T18:51:44.736703705+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1131, in eval
2024-07-10T18:51:44.736706245+08:00 stderr F     raise e from None
2024-07-10T18:51:44.736708653+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/component.py", line 1126, in eval
2024-07-10T18:51:44.736710949+08:00 stderr F     ret = self.__eval_callback(ctx=ctx, **kwargs)
2024-07-10T18:51:44.736713836+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/unified_single_party_ops/onehot_encode.py", line 224, in onehot_encode_eval_fn
2024-07-10T18:51:44.736723863+08:00 stderr F     (output_dd, model_dd, dist_rules_obj) = v_preprocessing_transform(
2024-07-10T18:51:44.736726692+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/preprocessing/core/table_utils.py", line 60, in v_preprocessing_transform
2024-07-10T18:51:44.736729162+08:00 stderr F     trans, remains = load_table_select_and_exclude_pair(
2024-07-10T18:51:44.736731414+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/data_utils.py", line 418, in load_table_select_and_exclude_pair
2024-07-10T18:51:44.736733605+08:00 stderr F     trans_x = load_table(
2024-07-10T18:51:44.736735979+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/component/data_utils.py", line 396, in load_table
2024-07-10T18:51:44.736738245+08:00 stderr F     shape = vdf.shape
2024-07-10T18:51:44.736740478+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/data/vertical/dataframe.py", line 217, in shape
2024-07-10T18:51:44.736742757+08:00 stderr F     self._check_parts()
2024-07-10T18:51:44.736744981+08:00 stderr F   File "/usr/local/lib/python3.10/site-packages/secretflow/data/vertical/dataframe.py", line 86, in _check_parts
2024-07-10T18:51:44.736747322+08:00 stderr F     assert self.partitions, 'Partitions in the VDataFrame is None or empty.'
2024-07-10T18:51:44.736749563+08:00 stderr F AssertionError: Partitions in the VDataFrame is None or empty.
@zimu-yuxi
Copy link
Collaborator

双方数据源可以提供下吗，我们看一下

@T-ze-yu
Copy link
Author

T-ze-yu commented Jul 12, 2024

p169dt.txt
p170dt.txt

@github-actions GitHub Actions
Copy link

Stale issue message. Please comment to remove stale tag. Otherwise this issue will be closed soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
no-issue-activity
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zimu-yuxi @T-ze-yu