Skip to content
This repository was archived by the owner on Feb 16, 2024. It is now read-only.

Conversation

snocke
Copy link
Contributor

@snocke snocke commented Oct 5, 2022

Description

When executing the hbase-hdfs demo on a non-kind cluster we have issues with storage.
After setting org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy = DEBUG we can see the actual error saying
2022-10-04 14:26:23,414 DEBUG blockmanagement.BlockPlacementPolicy: The node 10.104.0.29:9866 does not have enough DISK space (required=134217728, scheduled=1476395008, remaining=1482951146).

Review Checklist

  • Code contains useful comments
  • (Integration-)Test cases added (or not applicable)
  • Documentation added (or not applicable)
  • Changelog updated (or not applicable)
  • Cargo.toml only contains references to git tags (not specific commits or branches)

Once the review is done, comment bors r+ (or bors merge) to merge. Further information

@snocke snocke requested review from Jimvin and sbernauer October 5, 2022 07:34
@snocke snocke linked an issue Oct 5, 2022 that may be closed by this pull request
@snocke snocke marked this pull request as ready for review October 5, 2022 07:38
Copy link
Member

@sbernauer sbernauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we could rename the PR to something like hdfs-hbase stack: Increase pvc size

@snocke snocke changed the title fix storage error when working with a non-kind cluster hdfs-hbase stack: Increase pvc size Oct 5, 2022
@snocke
Copy link
Contributor Author

snocke commented Oct 5, 2022

bors merge

Copy link
Member

@Jimvin Jimvin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. We should be mindful that we might need to increase the datanode space further in the future, but this ought to be sufficient for the demo.

bors bot pushed a commit that referenced this pull request Oct 5, 2022
## Description

When executing the hbase-hdfs demo on a non-kind cluster we have issues with storage. 
After setting org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy = DEBUG we can see the actual error saying 
```2022-10-04 14:26:23,414 DEBUG blockmanagement.BlockPlacementPolicy: The node 10.104.0.29:9866 does not have enough DISK space (required=134217728, scheduled=1476395008, remaining=1482951146).```
@bors
Copy link

bors bot commented Oct 5, 2022

Pull request successfully merged into main.

Build succeeded:

@bors bors bot changed the title hdfs-hbase stack: Increase pvc size [Merged by Bors] - hdfs-hbase stack: Increase pvc size Oct 5, 2022
@bors bors bot closed this Oct 5, 2022
@bors bors bot deleted the 123-hbase-hdfs-demo-gcp-bug branch October 5, 2022 08:16
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

hbase-hdfs demo gcp bug
3 participants