Create forloop chain in the example pack#3328
Conversation
|
Thanks for the contribution - will review it shortly. |
|
From a high level the change looks good to me, but since we also use code from This way if we ever add tests for those new actions they will be more reliable and won't depend on 3rd party service which could be offline or unavailable because of various issues. |
That would be great. We would be happy to feature a guest post from you about this particular looping use case on our blog. Feel free to start a draft in google docs / github gist / similar and share it with us once you make some progress and we will work from there :) |
|
@lakshmi-kannan I'm personally fine with this change, but as mentioned above, I have some concerns with including it in the default What do others think? |
|
/cc @lakshmi-kannan @m4dcoder et. al - would be good to decide on how to proceed with that^ |
|
I will go ahead and merge this for now, but eventually it would be better if we moved to an example which is less error prone and doesn't depend on external service. Thanks again. |
|
Pushes a small style clean-up - #3428 In the future, please use 4 spaces for a tab (some how our automatic lint check didn't catch this). |
This is an example chain for a job that needs to be done in several steps because the bulk of each of the passes is bottlenecked (in the case I found, arguments between python calls cannot exceed 131072 characters). The "get_data" and the "push_data" actions can be from different packs if need be if they have support for "paging" on their requests.
If this feels valuable I could write something up more detailed as a blogpost to show how each of the steps work and post an example run and why anyone would want to use it. In this case, this is how it looks for now: