Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] DynamoDb source global state not found for export #3579

Closed
graytaylor0 opened this issue Nov 2, 2023 · 0 comments
Closed

[BUG] DynamoDb source global state not found for export #3579

graytaylor0 opened this issue Nov 2, 2023 · 0 comments
Assignees
Labels
bug Something isn't working
Milestone

Comments

@graytaylor0
Copy link
Member

graytaylor0 commented Nov 2, 2023

Describe the bug
When using the dynamo source with export and stream, after the export completed, I received the following exception continuously

 ERROR org.opensearch.dataprepper.sourcecoordination.enhanced.EnhancedLeaseBasedSourceCoordinator - Global state arn:aws:dynamodb:us-west-2:123456789012:table/SomeTable/stream/2023-11-01T21:46:45.879 is not found.

The only global items for this pipeline in the coordination store were

arn:aws:dynamodb:us-west-2:123456789012:table/SomeTable/export/01698897694319-d7dc03b8

and

arn:aws:dynamodb:us-west-2:123456789012:table/SomeTable

and there was no item for streams.

The export still went through successfully and then shards started. This may expected behavior and the log should just not be an ERROR log

To Reproduce
Not sure how to reproduce

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

@graytaylor0 graytaylor0 added bug Something isn't working untriaged and removed untriaged labels Nov 2, 2023
@graytaylor0 graytaylor0 added this to the v2.6 milestone Nov 2, 2023
@dlvenable dlvenable modified the milestones: v2.6, v2.7 Nov 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Archived in project
Development

No branches or pull requests

2 participants