Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch create presign URI #35643

Closed
filereadAndrew opened this issue May 15, 2024 · 5 comments
Closed

Batch create presign URI #35643

filereadAndrew opened this issue May 15, 2024 · 5 comments
Assignees
Labels
customer-reported Issues that are reported by GitHub users external to the Azure organization. issue-addressed The Azure SDK team member assisting with this issue believes it to be addressed and ready to close. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team. Storage Storage Service (Queues, Blobs, Files)

Comments

@filereadAndrew
Copy link

Is your feature request related to a problem? Please describe.
We migrated our code base over from aws to azure, and one thing that was really nice about aws was the ability to quickly generate presigned storage uri's locally which made batch processing them really easy. However, in azure land we have to roundtrip the request to generate a presign uri, and furthermore there seemingly is no batch operation supported. So any api requests that we need to generate multiple presigned urls which used to be a millisecond operation is now a really expensive 30sec to multiple minute operation.

Describe the solution you'd like
I would like to be able to submit multiple unsigned urls and receive a batch of presigned urls, or just be able process the urls locally with some cryptographic operation.

Describe alternatives you've considered
Solutions we have considered has been to severely over-engineer parts of our frontend to implement JIT logic to grab urls when we need them causing severe loading times.

@github-actions github-actions bot added customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels May 15, 2024
@jonathan-fileread
Copy link

+1

@xiangyan99 xiangyan99 added Storage Storage Service (Queues, Blobs, Files) Service Attention This issue is responsible by Azure service team. and removed needs-triage This is a new issue that needs to be triaged to the appropriate team. labels May 16, 2024
@github-actions github-actions bot added the needs-team-attention This issue needs attention from Azure service team or SDK team label May 16, 2024
Copy link

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jalauzon-msft @vincenttran-msft.

@jalauzon-msft
Copy link
Member

Hi @filereadAndrew, I'm not too familiar with aws pre-signed urls but if I understand correctly, I believe the equivalent in Azure is Shared Access Signature (SAS). You can generate a SAS URL with specific permissions to specific resources that expire after a certain time. SAS signatures/URLs are something you generate locally on the client-side so I'm not sure what roundtrip you are referring to needing.

In the Python SDK for example, you can generate a SAS using generate_blob_sas and append that to a corresponding Blob URL. generate_blob_sas does not make any network calls as the SAS is created locally. There are also generate_container_sas and generate_account_sas which can be used.

Hopefully that helps but let me know if you have any specific questions.

@jalauzon-msft jalauzon-msft added the issue-addressed The Azure SDK team member assisting with this issue believes it to be addressed and ready to close. label May 23, 2024
Copy link

Hi @filereadAndrew. Thank you for opening this issue and giving us the opportunity to assist. We believe that this has been addressed. If you feel that further discussion is needed, please add a comment with the text "/unresolve" to remove the "issue-addressed" label and continue the conversation.

@github-actions github-actions bot removed the needs-team-attention This issue needs attention from Azure service team or SDK team label May 23, 2024
Copy link

Hi @filereadAndrew, since you haven’t asked that we /unresolve the issue, we’ll close this out. If you believe further discussion is needed, please add a comment /unresolve to reopen the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
customer-reported Issues that are reported by GitHub users external to the Azure organization. issue-addressed The Azure SDK team member assisting with this issue believes it to be addressed and ready to close. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team. Storage Storage Service (Queues, Blobs, Files)
Projects
None yet
Development

No branches or pull requests

6 participants