-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] Reindex is break can not copy all documents from source #7878
Comments
Most likely this can not be the case, if you have set up, can you quickly verify reverting this commit ? |
revert this segment order change, issue has gone. @gashutos @nknize may have your insights here to why the sequence of segment impact query results? |
…verse segment read (opensearch-project#7244)" This reverts commit 4c98b3d. Reverting due to issue reported in opensearch-project#7878.
…verse segment read (opensearch-project#7244)" This reverts commit 4c98b3d. Reverting due to issue reported in opensearch-project#7878. Signed-off-by: Andrew Ross <andrross@amazon.com>
…verse segment read (opensearch-project#7244)" This reverts commit 4c98b3d. Reverting due to issue reported in opensearch-project#7878. Signed-off-by: Andrew Ross <andrross@amazon.com>
…verse segment read (opensearch-project#7244)" This reverts commit 4c98b3d. Reverting due to issue reported in opensearch-project#7878. Signed-off-by: Andrew Ross <andrross@amazon.com>
…tion through re… (#7895) * Revert "Time series based workload desc order optimization through reverse segment read (#7244)" (#7892) This reverts commit 4c98b3d. Reverting due to issue reported in #7878. Signed-off-by: Andrew Ross <andrross@amazon.com> (cherry picked from commit bb26536) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Remove unused imports Signed-off-by: Andrew Ross <andrross@amazon.com> --------- Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Andrew Ross <andrross@amazon.com>
Fixed by reverting in #7892, closing. |
…tion through re… (opensearch-project#7895) * Revert "Time series based workload desc order optimization through reverse segment read (opensearch-project#7244)" (opensearch-project#7892) This reverts commit 4c98b3d. Reverting due to issue reported in opensearch-project#7878. Signed-off-by: Andrew Ross <andrross@amazon.com> (cherry picked from commit bb26536) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Remove unused imports Signed-off-by: Andrew Ross <andrross@amazon.com> --------- Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Andrew Ross <andrross@amazon.com>
…verse segment read (opensearch-project#7244)" (opensearch-project#7892) This reverts commit 4c98b3d. Reverting due to issue reported in opensearch-project#7878. Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Describe the bug
Reindex only copy partial of source documents to destination, and seems this is only happened for index
opensearch_dashboards_sample_data_logs
which OSD provided as an example dataset.To Reproduce
Steps to reproduce the behavior:
Usig docker-compose.yml to spinup OpenSearch and OpenSearch dashboard
Import sample web logs data from OpenSearch dashboards
![image](https://private-user-images.githubusercontent.com/113890546/242833925-aae1ba25-ab8b-4e82-8518-6b596b8bafed.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjUzMTQ1OTUsIm5iZiI6MTcyNTMxNDI5NSwicGF0aCI6Ii8xMTM4OTA1NDYvMjQyODMzOTI1LWFhZTFiYTI1LWFiOGItNGU4Mi04NTE4LTZiNTk2YjhiYWZlZC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwOTAyJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDkwMlQyMTU4MTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0yYWYwNTczMzk2OTIyZjU1N2YzMmRkOGZlZWZmNDM1ZWQ0ZjNmYWJkMDcyNTgyNWFhM2Y4ZWNhYTgyZjZlZDQ4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.QwhW_rVWNQNbi3HN4SHAhZn7GjIFvfsGYre5WEVtQy0)
perform reindex for index
opensearch_dashboards_sample_data_logs
Expected behavior
Reindex should copy all documents from source index to dest, that say should 14074 documents reindexed.
Plugins
using docker-compose.yml
Screenshots
If applicable, add screenshots to help explain your problem.
Host/Environment (please complete the following information):
Additional context
OpenSearch 2.7 don't have this issue, test the same index, work as expected.
To see the segments of index
index mapping
seems that only segments
172.17.0.4 _b 11 3227
are searchedThe text was updated successfully, but these errors were encountered: