Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] Add redis_hash_tags_hypodispersion and using_hash_storage_slice to redis backend config. Change redis_connection_mode config, now redis_connection_mode = 2 will be standalone mode. #241

Merged
merged 1 commit into from
May 27, 2022

Conversation

MoFHeka
Copy link
Contributor

@MoFHeka MoFHeka commented May 12, 2022

Description

Add redis_hash_tags_hypodispersion to redis backend config.
If True, Distribution of storag_slice tag will be hypodispersion in 16354 regardless cluster slot, but still depends on redis_hash_tags_import/runtime if they aren't empty.

Add using_hash_storage_slice in redis config.
If True, IDs will be calculated hash(CRC32) value and then MOD to decide which bucket number they belong to.
If False, only calculate the remainder.

Change redis_connection_mode config, now redis_connection_mode = 2 will be standalone mode.

Also fix no redis sentinel password option in redis backend config.

Type of change

  • Bug fix
  • New Tutorial
  • Updated or additional documentation
  • Additional Testing
  • New Feature

Checklist:

  • I've properly formatted my code according to the guidelines
    • By running yapf
    • By running clang-format
  • This PR addresses an already submitted issue for TensorFlow Recommenders-Addons
  • I have made corresponding changes to the documentation
  • I have added tests that prove my fix is effective or that my feature works

How Has This Been Tested?

set redis_hash_tags_hypodispersion/using_hash_storage_slice to true or false in redis config.

@MoFHeka MoFHeka requested a review from rhdong as a code owner May 12, 2022 07:20
@MoFHeka MoFHeka changed the title [feat] Add redis_hash_tags_hypodispersion to redis backend config. [feat] Add redis_hash_tags_hypodispersion and using_crc32_storage_slice to redis backend config. May 16, 2022
@MoFHeka MoFHeka changed the title [feat] Add redis_hash_tags_hypodispersion and using_crc32_storage_slice to redis backend config. [feat] Add redis_hash_tags_hypodispersion and using_hash_storage_slice to redis backend config. May 16, 2022
@MoFHeka MoFHeka force-pushed the redis-dev branch 3 times, most recently from 7836389 to 554054c Compare May 21, 2022 04:33
@MoFHeka MoFHeka changed the title [feat] Add redis_hash_tags_hypodispersion and using_hash_storage_slice to redis backend config. [feat] Add redis_hash_tags_hypodispersion and using_hash_storage_slice to redis backend config. Change redis_connection_mode config, now redis_connection_mode = 2 will be standalone mode. May 24, 2022
Distribution of storag_slice tag will be hypodispersion in 16354 regardless cluster slot,
but still depends on redis_hash_tags_import/runtime if they aren't empty.

[feat] Add using_hash_storage_slice in redis config.
If True, IDs will be calculated hash(CRC32) value and then MOD to decide which bucket number they belong to.
If False, only calculate the remainder.

[feat] Change redis_connection_mode config
now redis_connection_mode = 2 will be standalone mode.

[fix] Fix no redis sentinel password option in redis backend config.
@rhdong rhdong merged commit e680e8e into tensorflow:master May 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants