Skip to content

Access the data through S3 Compat #308

@buremba

Description

@buremba

Apparently the data is stored in R2 and data.gharchive.org returns S3-like response. Unfortunately the engines such as Snowflake doesn't work with remote URLs and require S3 API implementation. The following query returns Endpoint data.gharchive.org not allowed..

CREATE STAGE my_r2_stage
  URL = 's3compat://my_bucket/files/'
  ENDPOINT = 'data.gharchive.org'

Would it be possible to share the R2 bucket URL so we can pull the data through the following script?

CREATE or REPLACE STAGE my_s3compat_stage
URL = 's3compat://your_bucket/'
ENDPOINT = 'your_account_id.r2.cloudflarestorage.com'
region = 'region_name'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions