Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TRIGGER] Pipedream Data Store - New Key in Data Store, Updated key in Data Store #9408

Open
vunguyenhung opened this issue Dec 21, 2023 · 3 comments
Assignees
Labels
blocked Issue is blocked pending a resolution enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed triaged For maintainers: This issue has been triaged by a Pipedream employee trigger / source New trigger / source request

Comments

@vunguyenhung
Copy link
Collaborator

vunguyenhung commented Dec 21, 2023

Describe the event source. What app is this for, and what event does the trigger correspond to?
App: Pipedream Data Store

Triggers:
I think this might need some development effort from the Pipedream internal team to develop subscription/webhook for datastore. Though, inittially it can be a polling source.

  • New Key in Data Store: emit event when there is a new key in a Data store. The event data should have key and value of the record in Data store
  • Updated key in Data Store: emit event when there the speicified key is updated in a Data store. The event data should have key, new value and old value of the record in Data store
  • Deleted Key in Data Store: emit event when a key deleted from a Data store. The event data should have key and value of the record in Data store

Please provide a link to the relevant API docs for the specific service / operation this trigger is tied to.
https://pipedream.com/docs/data-stores/

Context
Requested by a Business customer here: https://pipedream-users.slack.com/archives/CN1BUB92B/p1703118948881209

@vunguyenhung vunguyenhung added enhancement New feature or request help wanted Extra attention is needed good first issue Good for newcomers trigger / source New trigger / source request labels Dec 21, 2023
@vunguyenhung vunguyenhung added this to To Do in Component (Source and Action) Backlog via automation Dec 21, 2023
@dylburger dylburger added the triaged For maintainers: This issue has been triaged by a Pipedream employee label Dec 21, 2023
@mroy-seedbox
Copy link
Contributor

mroy-seedbox commented Dec 21, 2023

For "Updated Key in Data Store", what I had in mind is more like this:

  • User selects a datastore.
  • User selects an existing key.
  • An event is triggered whenever the value of that key is updated.

And another possible trigger could be "Deleted Key in Data Store". Ideally, the event for this trigger should contain the name of the key that was deleted.

@Supermikeydee
Copy link

Supermikeydee commented Dec 29, 2023

I have a slight enhancement \ use case where it would be awesome if we could have the trigger run WHLIE there is a key in the store (these above use cases are a great use case as well!) . I.E. Run every 5 mins while the Key exists. I would love to be able to use the key as "run this workflow while this key is populated" but don't run when it's not. This would save me close to a thousand credits a day and would allow me to notify end users a lot quicker when the data has been refreshed\updated. (pasting from my request on the community:) https://pipedream.com/community/t/trigger-based-existence-of-data-in-data-store/9696
(I also believe we are working on some PowerBI integrations so this may be moot in the coming months -- for now I just have a cron schedule keeping my window during normal refresh hours, and then moved it to run every 10 mins)

@malexanderlim malexanderlim moved this from To Do to Prioritized in Component (Source and Action) Backlog Jan 11, 2024
@michelle0927 michelle0927 self-assigned this Jan 15, 2024
@michelle0927 michelle0927 moved this from Prioritized to Doing in Component (Source and Action) Backlog Jan 15, 2024
@michelle0927 michelle0927 added the blocked Issue is blocked pending a resolution label Jan 15, 2024
@michelle0927
Copy link
Collaborator

Currently, datastores are not accessible from Pipedream sources.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked Issue is blocked pending a resolution enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed triaged For maintainers: This issue has been triaged by a Pipedream employee trigger / source New trigger / source request
Development

When branches are created from issues, their pull requests are automatically linked.

5 participants