Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

s3 client example #255

Closed
harlequin opened this issue Mar 9, 2022 · 2 comments
Closed

s3 client example #255

harlequin opened this issue Mar 9, 2022 · 2 comments
Assignees
Labels
bug Something isn't working no-issue-activity question Further information is requested

Comments

@harlequin
Copy link

harlequin commented Mar 9, 2022

Describe the bug
I have tried to get the minio client working with s3-proxy, but I always receive an error

$ ./mc ls proxy/airflow/logs/

mc.exe: <ERROR> Unable to list folder. Get "http://127.0.0.1:8080/?delimiter=%2F&encoding-type=url&fetch-owner=true&list-type=2&prefix=logs%2F": net/http: invalid header field value "AWS4-HMAC-SHA256 Credential=xxx/20220309/\n  \n/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=32330c79527f6f7c1498f56ad01324a5f535d6935784d438eeb01eb8368f0bac" for key Authorization

Configuration

authProviders:
  basic:
    provider1:
      realm: MyBasic

targets:  
  target1:
    mount:
      path:
        - /airflow/
    bucket:
      name: airflow # Bucket Name on remote storage system
      prefix:
      region: eu-west-1
      s3Endpoint: https://somewhere:10447
      disableSSL: false

      credentials:
        accessKey:
          value: xxx   
        secretKey:
          value: xxx 
    resource:
      - path: /airflow/*
        provider: provider1
        basic:
          credentials:
            - user: xxx
              password:
                value: xxx

mc client config

"proxy": {
   "url": "http://127.0.0.1:8080",
    "accessKey": "xxx",
    "secretKey": "xxx",
    "api": "S3v4",
    "path": "auto"
},
@harlequin harlequin added the bug Something isn't working label Mar 9, 2022
@oxyno-zeta
Copy link
Owner

oxyno-zeta commented Mar 9, 2022

Hello,

You are trying to access your Minio instance through s3-proxy using the awscli/minio cli ?
If yes, there is a misunderstanding here. S3-proxy is here to act as like a NGinX on files but on S3 buckets. It isn't a S3 endpoint proxy.

Regards,

PS: I planned to work a S3 endpoint proxy but it isn't done for the moment sorry...

@oxyno-zeta oxyno-zeta added the question Further information is requested label Mar 9, 2022
@oxyno-zeta oxyno-zeta self-assigned this Mar 9, 2022
@github-actions
Copy link

github-actions bot commented Apr 9, 2022

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 10 days

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working no-issue-activity question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants