-
Notifications
You must be signed in to change notification settings - Fork 355
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow a "newer than" timestamp to be specified for blob trigger #1327
Comments
I agree we should expose something to control this. Since we already maintain the blob scan pointer for tracking our last processed blob, we'd need to make sure that the behavior makes sense when these two interact. For sake of argument -- let's call this new property For example:
In other words -- we'd start our scan from whichever was newest between As a side note -- I think writing out informational logs (like we do for Timer) would be very helpful here. Something like |
This would be very helpful in a few scenarios i came across. My current case - scanning over SQL audit blobs generated by Azure's SQL Blob Auditing feature. This would really help similar scenarios. |
One possibility that could help here is using Event Grid's support for routing storage events to azure functions. This approach does not involve any blob scanning which is the cause of the main issue here. https://docs.microsoft.com/en-us/azure/event-grid/resize-images-on-storage-blob-upload-event |
Resurfacing this as this is something I would love to be able to do. Any idea on if/when this might be looked at? Thx! |
No idea at this time (that's what the "unknown" milestone means). |
Another year has passed - any update? |
Any update? This is kind of annoying as I have to sit there waiting for 10 minutes for the trigger to reprocess each blob. I'm not sure why but the receipts get reset sometimes which means it will reprocess everything |
Hello, I'm the same. In the cosole there are 3 events that are triggered at the same time: |
@pablosguajardo I think you're talking about something different to what is being discussed here, because it looks you are using eventgrid, while this issue is discussing the behavior of the built-in blob trigger.. |
Any update on this? This feature would be very useful. |
Is this related to the same blob being triggered for multiple hosts? For example, a blob already processed by a production Function, is also triggered when a dev machine runs the function/project locally. We've seen files from YEARS start to trigger for processing. |
Any Updates on this functionality? |
Any update on the above discussion? |
Really need this feature!! Please help add it : ) |
More than 6 years after, can we at least have news about it ? |
I am also hoping for this feature as well, cause when you first publish the trigger in the function app and you have an existing blob with files. You upload one for testing, instead of taking just the testing one. It takes the testing plus any other files in it. But after that, its fine. Next file you upload, it will only trigger for that folder. |
This would be really helpful! |
Currently our blob scan algorithm will process ALL blobs in the target container that don't have blob receipts. We should investigate whether we can allow the start date for the scan to be specified.
Scenario: assume all blobs in a container have been processed by a blob trigger function in a particular app (WebJob host). Now, if that function is moved to a different app (different host/host ID) all the blobs will be reprocessed, because there are no receipts for those blobs for that host ID.
The text was updated successfully, but these errors were encountered: