Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[volume.check.disk] sync volume : rpc error: code = ResourceExhausted desc = grpc: trying to send message larger than max (1291232846 vs. 1073741824 #2966

Closed
kmlebedev opened this issue Apr 25, 2022 · 2 comments
Closed

[volume.check.disk] sync volume : rpc error: code = ResourceExhausted desc = grpc: trying to send message larger than max (1291232846 vs. 1073741824 #2966

kmlebedev opened this issue Apr 25, 2022 · 2 comments

Comments

@kmlebedev
Copy link
Contributor

logs

> volume.check.disk -v -force -nonRepairThreshold 0.6
load collection logs-prod volume 567 index size 243219 from slow-volume-18.dc1:8080 ...
load collection logs-prod volume 567 index size 243185 from slow-volume-15.dc2:8080 ...
volume 567 slow-volume-15.dc2:8080 has 8464 entries, slow-volume-18.dc1:8080 missed 4611 entries
read 567,333337663263323161 slow-volume-15.dc2:8080 => slow-volume-18.dc1:8080
read 567,383038663263323161 slow-volume-15.dc2:8080 => slow-volume-18.dc1:8080
read 567,31366163663263323161 slow-volume-15.dc2:8080 => slow-volume-18.dc1:8080
sync volume 567 on slow-volume-18.dc1.consul:8080 and slow-volume-15.dc2.consul:8080: doVolumeCheckDisk source:id:"slow-volume-15.dc2.consul:8080"  diskInfos:{} grpc_port:18080 volume 567: rpc error: code = ResourceExhausted desc = grpc: trying to send message larger than max (1291232846 vs. 1073741824)
@kmlebedev
Copy link
Contributor Author

Seems I'm running seaweedfs without build tag 5BytesOffset
Perhaps this could lead to #2927

@kmlebedev
Copy link
Contributor Author

@chrislusf Can make foolproof. Whatever weed did not run on data with 5BytesOffset

kmlebedev added a commit to kmlebedev/seaweedfs that referenced this issue Oct 13, 2022
@kmlebedev
avoid load volume file with BytesOffset mismatch
4524553 
seaweedfs#2966
@kmlebedev kmlebedev mentioned this issue Oct 13, 2022
Merged
2 tasks
chrislusf pushed a commit that referenced this issue Oct 14, 2022
@kmlebedev
avoid load volume file with BytesOffset mismatch (#3841)
2f72103 
* avoid load volume file with BytesOffset mismatch

#2966

* set BytesOffset if has not VolumeInfoFile

* typos fail => failed

* exit if bytesOffset mismatch
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kmlebedev