Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Background jobs service #245

Open
Nekroze opened this issue Jan 2, 2019 · 3 comments
Open

Background jobs service #245

Nekroze opened this issue Jan 2, 2019 · 3 comments
Labels
Feature New feature or request for major functionality changes

Comments

@Nekroze
Copy link
Owner

Nekroze commented Jan 2, 2019

Feature Request

Is your feature request related to a problem? Please describe

Performance and continued development are hampered by having to complete all things synchronously.

Describe the solution you'd like

Add a always running container that can do more long running data operations when asked to via some interface. For example the git fetching of dab repo list could be done periodically and asynchronously to make the command much faster as that operation was done in the background recently.

Describe alternatives you've considered

Doing things synchronously can make every command slow even when they should be quick. Have also made some hooks run in the background however because the final action must be to wait for them to finish the gains are small.

@Nekroze Nekroze added the Feature New feature or request for major functionality changes label Jan 2, 2019
@Nekroze
Copy link
Owner Author

Nekroze commented Jan 2, 2019

Could also handle image updates for dab apps.

@Nekroze
Copy link
Owner Author

Nekroze commented Jan 2, 2019

Might be able to use some existing generic message/job queue service.

@Nekroze Nekroze changed the title Async data gathering service Background data gathering service Jan 2, 2019
@Nekroze Nekroze changed the title Background data gathering service Background jobs service Feb 6, 2019
@Nekroze
Copy link
Owner Author

Nekroze commented Feb 6, 2019

Things to run periodically in the background:

  • fetch on all repos to make report list near instant
  • update the dab image so normal operations are not slowed unexpectedly
    Events to handle in the background:
  • dab commands logged and annotated in chronograf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature New feature or request for major functionality changes
Projects
None yet
Development

No branches or pull requests

1 participant