Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: insert enwiki datasets failed #1125

Closed
1 task done
yangjie407 opened this issue Apr 27, 2024 · 2 comments
Closed
1 task done

[Bug]: insert enwiki datasets failed #1125

yangjie407 opened this issue Apr 27, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@yangjie407
Copy link
Contributor

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Branch name

main

Commit ID

a144119

Other environment information

No response

Actual behavior

When I insert enwiki datasets into infinity (line by line), I encounted the exception below:
Traceback (most recent call last):
File "/home/ubuntu/infinity/python/benchmark/run.py", line 65, in
client.run_experiment(args)
File "/home/ubuntu/infinity/python/benchmark/clients/base_client.py", line 70, in run_experiment
self.upload()
File "/home/ubuntu/infinity/python/benchmark/clients/infinity_client.py", line 73, in upload
table_obj.insert(actions)
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/infinity/remote_thrift/table.py", line 214, in insert
raise Exception(f"ERROR:{res.error_code}, {res.error_msg}")
Exception: ERROR:5003, retry insert failed
Exception ignored in: <function RemoteThriftInfinityConnection.del at 0x7fdcd1655d00>
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/infinity/remote_thrift/infinity.py", line 36, in del
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/infinity/remote_thrift/infinity.py", line 96, in disconnect
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/infinity/remote_thrift/client.py", line 201, in disconnect
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/infinity/remote_thrift/infinity_thrift_rpc/InfinityService.py", line 305, in Disconnect
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/infinity/remote_thrift/infinity_thrift_rpc/InfinityService.py", line 314, in send_Disconnect
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/thrift/transport/TTransport.py", line 179, in flush
File "/home/ubuntu/anaconda3/envs/openai_test/lib/python3.11/site-packages/thrift/transport/TSocket.py", line 185, in write
thrift.transport.TTransport.TTransportException: unexpected exception

Expected behavior

No response

Steps to reproduce

insert enwiki.csv into infinity.

Additional information

No response

@yangjie407 yangjie407 added the bug Something isn't working label Apr 27, 2024
@Ognimalf
Copy link
Contributor

It's ok on my machine, even if I set the retry times to 1 in python client.

yuzhichang added a commit that referenced this issue May 2, 2024
Let thrift client reconnect on insert failure
Updated requirements.txt

Issue link:#1125

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
yuzhichang added a commit that referenced this issue May 2, 2024
Let thrift client reconnect on insert failure
Updated requirements.txt

Issue link:#1125

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
@yuzhichang
Copy link
Member

Fixed by #1156

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants