Skip to content

Conversation

@ViBiOh
Copy link
Contributor

@ViBiOh ViBiOh commented Nov 25, 2025

The idea is to not fail at the API validation step, at the very beginning of the forwarder, for an external reason.

If we know for sure that the API key is wrong (default of invalid length), we fail as usual. But, if we failed to validate against Datadog API and failed event is enabled, we continue the process and best case scenario, the API verification had a hiccup and logs forwarding just works, or the events will be stored into the S3 bucket to be reprocess later.

When we fail at the very beginning of the forwarder, there is no retry mechanism built-in in Lambda to retry it, so we can lose events for 429 reason for example.

What does this PR do?

Motivation

Testing Guidelines

Additional Notes

Types of changes

  • Bug fix
  • New feature
  • Breaking change
  • Misc (docs, refactoring, dependency upgrade, etc.)

Check all that apply

  • This PR's description is comprehensive
  • This PR contains breaking changes that are documented in the description
  • This PR introduces new APIs or parameters that are documented and unlikely to change in the foreseeable future
  • This PR impacts documentation, and it has been updated (or a ticket has been logged)
  • This PR's changes are covered by the automated tests
  • This PR collects user input/sensitive content into Datadog
  • This PR passes the integration tests (ask a Datadog member to run the tests)
  • This PR passes the unit tests
  • This PR passes the installation tests (ask a Datadog member to run the tests)

@ViBiOh ViBiOh requested review from a team as code owners November 25, 2025 10:59
@github-actions github-actions bot added the aws label Nov 25, 2025
…age of failed event enabled

Signed-off-by: Vincent Boutour <vincent.boutour@datadoghq.com>
Signed-off-by: Vincent Boutour <vincent.boutour@datadoghq.com>
@ViBiOh ViBiOh force-pushed the vibioh/AWSX-2034_api_key_retry branch from 66aa2ad to a813e27 Compare November 25, 2025 15:30
AWS_SECURITY_TOKEN: "${AWS_SECURITY_TOKEN}"
AWS_SESSION_TOKEN: "${AWS_SESSION_TOKEN}"
AWS_DEFAULT_REGION: us-east-1
DD_LOG_LEVEL: ${LOG_LEVEL:-info}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

alpha sort while passing by

…ut storage of failed event enabled

Signed-off-by: Vincent Boutour <vincent.boutour@datadoghq.com>
@ViBiOh ViBiOh changed the title feat(aws): AWSX-2034 Continue if we fail to validate api key but stor… feat(aws): AWSX-2034 Continue if we fail to validate api key but storage of failed event enabled Nov 25, 2025
@ViBiOh ViBiOh merged commit 7260eb4 into master Nov 26, 2025
11 checks passed
@ViBiOh ViBiOh deleted the vibioh/AWSX-2034_api_key_retry branch November 26, 2025 10:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants