Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

out_s3: New plugin for Amazon S3 #2583

Merged
merged 8 commits into from
Sep 25, 2020
Merged

out_s3: New plugin for Amazon S3 #2583

merged 8 commits into from
Sep 25, 2020

Commits on Sep 25, 2020

  1. aws: s3 key format option 

    Signed-off-by: Meghna Prabhu <meghnapr@amazon.com>
    @meghnapr @PettitWesley
    meghnapr authored and PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    fdee0bf View commit details
    Browse the repository at this point in the history

  2. signv4: Support S3 Signed Payload 

    Signed-off-by: Wesley Pettit <wppttt@amazon.com>
    @PettitWesley
    PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    af526c7 View commit details
    Browse the repository at this point in the history

  3. out_es: update with new signv4 api 

    Signed-off-by: Wesley Pettit <wppttt@amazon.com>
    @PettitWesley
    PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    daa9e42 View commit details
    Browse the repository at this point in the history

  4. aws: add new S3 local buffering library 

    Signed-off-by: Wesley Pettit <wppttt@amazon.com>
    @PettitWesley
    PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    5769d83 View commit details
    Browse the repository at this point in the history

  5. aws: s3 object key formatting and request signing 

    Signed-off-by: Wesley Pettit <wppttt@amazon.com>
    @PettitWesley
    PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    e688a73 View commit details
    Browse the repository at this point in the history

  6. out_s3: new output plugin for Amazon S3 

    Signed-off-by: Wesley Pettit <wppttt@amazon.com>
    @PettitWesley
    PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    29a8976 View commit details
    Browse the repository at this point in the history

  7. out_s3: use new fstore API plus other adjustments 

     - use new fstore API for buffer management
 - register plugin flags
 - config: change configmap for TIME and SIZE value types
 - config: rename chunk_buffer_dir -> store_dir
 - fix leaks on exceptions
 - use field to 'lock' chunks, instead of temporary node deletion
 - others adjustments

note: still work in process.

Signed-off-by: Eduardo Silva <eduardo@treasure-data.com>
    @edsiper @PettitWesley
    edsiper authored and PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    f2fae74 View commit details
    Browse the repository at this point in the history

  8. aws: fix broken s3 key test 

    Signed-off-by: Wesley Pettit <wppttt@amazon.com>
    @PettitWesley
    PettitWesley committed Sep 25, 2020
    Configuration menu
    Copy the full SHA
    c081071 View commit details
    Browse the repository at this point in the history