Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AWS Plugins can not connect to AWS services using docker build #3154

Closed
zhonghui12 opened this issue Mar 4, 2021 · 3 comments
Closed

AWS Plugins can not connect to AWS services using docker build #3154

zhonghui12 opened this issue Mar 4, 2021 · 3 comments
Labels

Comments

@zhonghui12
Copy link
Contributor

Bug Report

Describe the bug

I tried to use docker build to build latest code and it succeeds. However, it failed when I tried to upload S3 project. I got below error information:

[2021/03/03 23:07:35] [debug] [upstream] connection #27 failed to s3.us-east-1.amazonaws.com:443
[2021/03/03 23:07:35] [error] [aws_client] connection initialization error
[2021/03/03 23:07:35] [error] [output:s3:s3.0] PutObject request failed
[2021/03/03 23:07:35] [debug] [out coro] cb_destroy coro_id=13
[2021/03/03 23:07:35] [debug] [retry] new retry created for task_id=0 attempts=1
[2021/03/03 23:07:35] [ warn] [engine] failed to flush chunk '1-1614812850.640600300.flb', retry in 6 seconds: task_id=0, input=mem.0 > output=s3.0 (out_id=0)
[2021/03/03 23:07:40] [debug] [output:s3:s3.0] Running upload timer callback..
[2021/03/03 23:07:40] [debug] [upstream] connection #28 failed to s3.us-east-1.amazonaws.com:443
[2021/03/03 23:07:40] [error] [aws_client] connection initialization error
[2021/03/03 23:07:40] [error] [output:s3:s3.0] PutObject request failed
[2021/03/03 23:07:40] [error] [output:s3:s3.0] Could not send chunk with tag mem
[2021/03/03 23:07:40] [debug] [task] created task=0x7f94d6e37500 id=1 OK
[2021/03/03 23:07:40] [ info] [output:s3:s3.0] upload_timeout reached for mem
[2021/03/03 23:07:40] [debug] [upstream] connection #28 failed to s3.us-east-1.amazonaws.com:443
[2021/03/03 23:07:40] [error] [aws_client] connection initialization error
[2021/03/03 23:07:40] [error] [output:s3:s3.0] PutObject request failed

And we also tried the cloudwatch one, it also had the same issue. I saw several closed issues about it: #2927, #3084. It seems like the public docker image is fixed as it works when we ran fluent/fluent-bit:1.7 docker image. But the Dockerfile isn't fixed so the docker build fails.
To Reproduce

  • My config file:
[SERVICE]
    Log_Level debug
[INPUT]
    Name mem
    Tag mem
[OUTPUT]
    Name s3
    Match *
    bucket test-s3-fluent-bit
    region us-east-1
    total_file_size 1M
    upload_timeout 1m
    use_put_object On
  • Steps to reproduce the problem:
  1. Use docker to build the code: docker build -t s3-image .
  2. Run the image using above config file

Your Environment

  • Version used: 1.7.0
  • Configuration:
  • Environment name and version (e.g. Kubernetes? What version?):
  • Server type and version:
  • Operating System and version:
  • Filters and plugins: s3/cw

Additional context

@zhonghui12
Copy link
Contributor Author

Hello Eduardo, any update on this issue? @edsiper

@github-actions
Copy link
Contributor

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the Stale label Apr 25, 2021
@github-actions
Copy link
Contributor

github-actions bot commented May 4, 2021

This issue was closed because it has been stalled for 5 days with no activity.

@github-actions github-actions bot closed this as completed May 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant