Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to only index workflows on Postgres when their status changes #83

Merged
merged 1 commit into from
Mar 5, 2024

Conversation

bjpirt
Copy link
Contributor

@bjpirt bjpirt commented Feb 21, 2024

Pull Request type

  • Feature

Changes in this PR

Currently the Postgres IndexDAO will index every change to a workflow and task. However if you're only really using the index so that you can find things in the UI, then this might be excessive.

This option allows you to choose to only index the workflows and tasks when they change status.

Pros and Cons

  • Fewer Postgres queries
  • COMPLETE workflows will still have an up to date index
  • Basic querying still works from the UI
  • Long running workflows will have an out of date index
  • More complex queries may not find up-to-date workflows if the status hasn't changed

@bjpirt bjpirt marked this pull request as ready for review February 22, 2024 08:01
@bjpirt bjpirt force-pushed the index-on-status-change branch 2 times, most recently from 1cf6022 to 9fbcb9a Compare March 4, 2024 11:22
@v1r3n v1r3n merged commit e195ef6 into conductor-oss:main Mar 5, 2024
2 checks passed
matiasbur pushed a commit to preqin/conductor that referenced this pull request May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants