Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AttributeGroup APIs in stress test - PutEntity and GetEntity #12605

Closed

Conversation

jaykorean
Copy link
Contributor

@jaykorean jaykorean commented May 2, 2024

Summary

Adding AttributeGroup APIs in stress test. This contains the following changes only. More PRs to follow.

  • Introduce use_attribute_group flag
  • AttributeGroup PutEntity() and GetEntity() are now used per use_attribute_group flag in BatchOps, NonBatchOps and CfConsistency tests

In the next PRs I plan to add

  • AttributeGroup MultiGetEntity() in Stress Test
  • AttributeGroupIterator in Stress Test (along with CoalescingIterator)

Test Plan

NonBatchOps

python3 tools/db_crashtest.py blackbox --simple --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=1 --use_put_entity_one_in=1

BatchOps

python3 tools/db_crashtest.py blackbox --test_batches_snapshots=1 --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=1 --use_put_entity_one_in=1

CfConsistency Test

python3 tools/db_crashtest.py blackbox --cf_consistency --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=1 --use_put_entity_one_in=1

@jaykorean jaykorean requested a review from ltamasi May 2, 2024 20:53
@jaykorean jaykorean changed the title Attribute group in stress test - PutEntity and GetEntity AttributeGroup APIs in stress test - PutEntity and GetEntity May 2, 2024
@jaykorean jaykorean force-pushed the attribute_group_in_stress_test branch 2 times, most recently from e30db73 to c81fb69 Compare May 2, 2024 21:14
@jaykorean jaykorean marked this pull request as ready for review May 3, 2024 01:01
@facebook-github-bot
Copy link
Contributor

@jaykorean has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Copy link
Contributor

@ltamasi ltamasi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jaykorean ! LGTM, just some minor comments

db_stress_tool/cf_consistency_stress.cc Show resolved Hide resolved
db_stress_tool/cf_consistency_stress.cc Show resolved Hide resolved
db_stress_tool/cf_consistency_stress.cc Outdated Show resolved Hide resolved
db_stress_tool/batched_ops_stress.cc Outdated Show resolved Hide resolved
db_stress_tool/db_stress_common.cc Outdated Show resolved Hide resolved
db_stress_tool/no_batched_ops_stress.cc Outdated Show resolved Hide resolved
@jaykorean jaykorean force-pushed the attribute_group_in_stress_test branch from d91d65e to b6686fe Compare May 9, 2024 22:33
@facebook-github-bot
Copy link
Contributor

@jaykorean has updated the pull request. You must reimport the pull request before landing.

@facebook-github-bot
Copy link
Contributor

@jaykorean has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@jaykorean merged this pull request in 1f2715d.

@jaykorean jaykorean deleted the attribute_group_in_stress_test branch May 10, 2024 03:01
facebook-github-bot pushed a commit that referenced this pull request May 14, 2024
Summary:
Continuing from #12605, adding AttributeGroup `MultiGetEntity` API to stress tests.

Pull Request resolved: #12640

Test Plan:
**AttributeGroup Tests**

NonBatchOps
```
python3 tools/db_crashtest.py blackbox --simple --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=1 --use_put_entity_one_in=1 --use_multi_get=1
```

BatchOps
```
python3 tools/db_crashtest.py blackbox  --test_batches_snapshots=1 --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=1 --use_put_entity_one_in=1 --use_multi_get=1
```

CfConsistency Test
```
python3 tools/db_crashtest.py blackbox --cf_consistency --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=1 --use_put_entity_one_in=1 --use_multi_get=1
```

**Non-AttributeGroup Tests**

NonBatchOps
```
python3 tools/db_crashtest.py blackbox --simple --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=0 --use_put_entity_one_in=1 --use_multi_get=1
```

BatchOps
```
python3 tools/db_crashtest.py blackbox  --test_batches_snapshots=1 --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=0 --use_put_entity_one_in=1 --use_multi_get=1
```

CfConsistency Test
```
python3 tools/db_crashtest.py blackbox --cf_consistency --max_key=25000000 --write_buffer_size=4194304 --use_attribute_group=0 --use_put_entity_one_in=1 --use_multi_get=1
```

Reviewed By: ltamasi

Differential Revision: D57233931

Pulled By: jaykorean

fbshipit-source-id: 8cea771ac2e5749050bf5319360c6c5aa476d7d5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants