Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add debug log after s3 put #414

Open
statefb opened this issue Jan 16, 2023 · 1 comment
Open

Add debug log after s3 put #414

statefb opened this issue Jan 16, 2023 · 1 comment

Comments

@statefb
Copy link

statefb commented Jan 16, 2023

Is your feature request related to a problem? Please describe.

arch
We'd like to send relatively large size data to Kinesis Data Streams. Due to the price problem, I'm considering send only meta data and body content is sent via S3. To do so, capturing debug log before putting in S3, parse it and then send to Kinesis is an idea. But if sending data to S3 takes some time, consumer may fail to fetch body content from S3 because placing in S3 possibly has not been completed and not existed. Can I add debug log after sending S3?

Describe the solution you'd like

Add log statement

Describe alternatives you've considered

@bucket.object(s3path).put(put_options)

+ log.debug "out_s3: completed put chunk to s3 #{dump_unique_id_hex(chunk.unique_id)} with metadata #{chunk.metadata} to s3://#{@s3_bucket}/#{s3path}"

Additional context

No response

@github-actions
Copy link

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants