Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use the new Azure SDK for C++. #3910

Merged
merged 40 commits into from
Apr 23, 2023
Merged

Use the new Azure SDK for C++. #3910

merged 40 commits into from
Apr 23, 2023

Commits on Apr 11, 2023

  1. Add dependency to the new Azure SDK via vcpkg and remove the old one.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    dc7b102 View commit details
    Browse the repository at this point in the history

  2. Port the Azure Blob Storage client construction to the new SDK.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    c2ac7f8 View commit details
    Browse the repository at this point in the history

  3. Start porting some operations to the new SDK.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    03279f6 View commit details
    Browse the repository at this point in the history

  4. Port read and touch.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    abaa16b View commit details
    Browse the repository at this point in the history

  5. Port five more operations.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    e4c895d View commit details
    Browse the repository at this point in the history

  6. Port copy_blob.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    6903d11 View commit details
    Browse the repository at this point in the history

  7. Finish the porting with the write code.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    4dc60f7 View commit details
    Browse the repository at this point in the history

  8. Fix compile errors.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    fc0c4de View commit details
    Browse the repository at this point in the history

  9. Avoid explicitly unlocking locks.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    009bc38 View commit details
    Browse the repository at this point in the history

  10. Remove unsupported config options and add relevant warnings.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    6706d63 View commit details
    Browse the repository at this point in the history

  11. Use TileDB unique pointers.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    14640a6 View commit details
    Browse the repository at this point in the history

  12. Remove deprecated config options.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    1f2b208 View commit details
    Browse the repository at this point in the history

  13. Log events from the Azure SDK.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    801d903 View commit details
    Browse the repository at this point in the history

  14. Use make_unique in one occasion.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    2726b32 View commit details
    Browse the repository at this point in the history

  15. Remove DenseArrayFx::set_small_memory_budget. 

    It was resetting the context to one that does not have the VFS config options set.
Instead we create another config and set it to the array and query.
    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    efea433 View commit details
    Browse the repository at this point in the history

  16. Fix formatting.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    b6e8cbb View commit details
    Browse the repository at this point in the history

  17. Remove polling for blob/container propagation/deletion. 

    Context: MicrosoftDocs/azure-docs#105331.
    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    d670870 View commit details
    Browse the repository at this point in the history

  18. Bring back polling for blob propagation, for copying blobs.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    12e5767 View commit details
    Browse the repository at this point in the history

  19. Update Azurite version on Linux.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    bfafa62 View commit details
    Browse the repository at this point in the history

  20. Clone submodules on Windows CI.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    a90b100 View commit details
    Browse the repository at this point in the history

  21. Do not depend on libcurl if we use Azure.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    b688d7c View commit details
    Browse the repository at this point in the history

  22. Fix indentation in vcpkg.json.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    f0c1421 View commit details
    Browse the repository at this point in the history

  23. Fix documentation of the vfs.azure.blob_endpoint option.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    f5e9209 View commit details
    Browse the repository at this point in the history

  24. Avoid calling getenv many times.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    806d959 View commit details
    Browse the repository at this point in the history

  25. Do not warn about the Azure blob endpoint's scheme when it is not spe… 

    …cified.
    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    1c84903 View commit details
    Browse the repository at this point in the history

  26. Simplify checking for the SAS token config option and use nullptr.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    e81d9c6 View commit details
    Browse the repository at this point in the history

  27. Use the default Azure SDK retry policy.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    0b6f43e View commit details
    Browse the repository at this point in the history

  28. Remove vcpkg port overlays for the old Azure SDK.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    f8e5e79 View commit details
    Browse the repository at this point in the history

  29. Include the Azure SDK headers first.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    f431d9b View commit details
    Browse the repository at this point in the history

  30. Use PollUntilDone to wait until the blob copying completes.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    502ebbc View commit details
    Browse the repository at this point in the history

  31. Fix formatting and compile errors.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    a9b9bfd View commit details
    Browse the repository at this point in the history

  32. Build spdlog as a static library.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    26143c7 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. Merge remote-tracking branch 'origin/dev' into teo-azure

    @ihnorton
    ihnorton committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    699aaa4 View commit details
    Browse the repository at this point in the history

  2. Install missing autoconf/make required for build

    @ihnorton
    ihnorton committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    79261a2 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2023

  1. Fixes for Dockerfile build w/ vcpkg

    @ihnorton
    ihnorton committed Apr 16, 2023
    Configuration menu
    Copy the full SHA
    e2549e1 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2023

  1. Fix typo.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    6d83532 View commit details
    Browse the repository at this point in the history

  2. Fix formatting.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    b234248 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Clean-up leftovers from removed config options.

    @teo-tsirpanis
    teo-tsirpanis committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    df260f3 View commit details
    Browse the repository at this point in the history

  2. Add config options for the Azure retry policies. 

    They map to what the Azure SDK exposes and have its default values.
    @teo-tsirpanis
    teo-tsirpanis committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    ff79e3e View commit details
    Browse the repository at this point in the history

  3. Set the default value for vfs.azure.max_retries to 5; the same with… 

    … S3.
    @teo-tsirpanis
    teo-tsirpanis committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    7fbc6c6 View commit details
    Browse the repository at this point in the history