Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TMFS] Address minors from #7313 & support auto second tier creation & assignment if configured #7360

Conversation

tangledbytes
Copy link
Member

Explain the changes

This PR:

  1. Adds support for auto tier 2 creation and assignment to backingstore buckets if TMFS_BUCKET_TIER2_AUTOCONF and BLOCK_STORE_FS_TMFS_ENABLED are enabled. Created another config parameter instead of linking it to BLOCK_STORE_FS_TMFS_ENABLED to provide slightly more control over behaviour hopefully helpful while debugging.
  2. Addresses minors from Tiering with storage class support - TTL based worker + TMFS blocks migration #7313 by removing the js_utils function and renaming the functions.

PS: 2nd change was introduced accidentally as a result of creating a branch off my previous branch (which had the changes). I can split the PR into 2 different PRs or merge the 2 commits, I have no preference here.

  • Doc added/updated
  • Tests added

@tangledbytes tangledbytes force-pushed the utkarsh-pro/add/support-bucket-tmfs-autoconf branch from c6f4e4b to c68d17a Compare June 22, 2023 11:39
Copy link
Member

@guymguym guymguym left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Few changes needed. Thanks

src/agent/block_store_services/block_store_fs.js Outdated Show resolved Hide resolved
src/sdk/map_client.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
config.js Outdated Show resolved Hide resolved
@tangledbytes tangledbytes force-pushed the utkarsh-pro/add/support-bucket-tmfs-autoconf branch 4 times, most recently from 8d5d5cc to 1041bed Compare June 22, 2023 15:15
Copy link
Member

@guymguym guymguym left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added few small comments. I love how you reused the code in auto_setup_tier2!

src/server/system_services/system_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
src/server/system_services/bucket_server.js Show resolved Hide resolved
src/server/system_services/bucket_server.js Outdated Show resolved Hide resolved
@tangledbytes tangledbytes force-pushed the utkarsh-pro/add/support-bucket-tmfs-autoconf branch from 1041bed to 401eaac Compare June 22, 2023 16:20
Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

add auto tier 2 creation & assignment to bucket if configured

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

fix issues

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

fix docs

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

fix deepscan

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

cleanup auto_setup_tier2

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>
@tangledbytes tangledbytes force-pushed the utkarsh-pro/add/support-bucket-tmfs-autoconf branch from 401eaac to 995c7da Compare June 22, 2023 16:58
Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

add auto tier 2 creation & assignment to bucket if configured

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

fix issues

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

fix docs

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

fix deepscan

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

cleanup auto_setup_tier2

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

cleanup auto_setup_tier2 and reduce agent_blocks_reclaimer log verbosity

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>
@tangledbytes tangledbytes merged commit d2e0c6a into noobaa:master Jun 23, 2023
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants