Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support the KEDA ScaledJobs / Jobs Pattern #24

Closed
jeffhollan opened this issue Nov 11, 2021 · 21 comments
Closed

Support the KEDA ScaledJobs / Jobs Pattern #24

jeffhollan opened this issue Nov 11, 2021 · 21 comments
Assignees
Labels
enhancement New feature or request

Comments

@jeffhollan
Copy link

KEDA supports a pattern of ScaledJobs for containers or jobs that "run to completion". This is especially useful if you are pulling messages from a queue or event source and want to have it run to completion without scaling down

https://keda.sh/docs/2.4/concepts/scaling-jobs/

This could also be merged with the traditional "job" concept - and expose a "manual invoke" ability where you can kick off the job without it being tied to an event with something like az containerapp invoke-job -n myjob --image {}

@jeffhollan jeffhollan changed the title Support the ScaledJobs Pattern Support the KEDA ScaledJobs / Jobs Pattern Nov 11, 2021
@dariagrigoriu dariagrigoriu added the enhancement New feature or request label Nov 12, 2021
@kendallroden kendallroden added this to Requested Enhancements in Feature Requests Apr 21, 2022
@guidooliveira
Copy link

This would support one of my most needed use cases, having it work as an Azure Pipelines/Github Actions pool.

@Manbearpiet
Copy link

This would support one of my most needed use cases, having it work as an Azure Pipelines/Github Actions pool.

Yeah we are eagerly waiting for this same usecase too, have mentioned it on Discord a few times.

@shahiddev
Copy link

Adding my voice to this too. This is key for us to enable the use of containerapps for a bunch of deployment pipeline situations where we need jobs to run to completion.

@safari137
Copy link

This would be very beneficial for the use cases we have for container apps as well.

@tmakowka-tc
Copy link

We are currently looking into utilizing Container Apps for our workloads. Since we need to run numerous long-running batch jobs and would like to scale those via KEDA Queues, we are very interested in having ScaledJobs support in CA. Otherwise we cannot utilize CA for our workloads in this case.

@henriksen
Copy link

Would be useful for our use cases as well. Have a lot of minor apps that should start every now and again, do their thing to completion and then scale down automatically. Based mostly on cron expressions and EventGrid triggers (HTTP).

@kendallroden
Copy link
Contributor

we will be working on jobs and support for this will happen with support for jobs!

@kendallroden kendallroden added roadmap This feature is on the roadmap Scale related to scaling behavior labels Sep 14, 2022
@kendallroden kendallroden self-assigned this Sep 14, 2022
@ezYakaEagle442
Copy link

one of my customers ask for this feature as well

@Mike-Kolter
Copy link

Any ETA on this one?

@kendallroden
Copy link
Contributor

We are making progress in design phase - will keep updated

@jagusztinl
Copy link

One of our customers ask for this feature as well!

Where is the official roadmap of ContainerAppService?

@BC89
Copy link

BC89 commented Nov 18, 2022

Need this feature too. Our use case is around processing lidar data in a container app which would require long-running jobs and even vertical scaling of resources for particular batch jobs.

@michal-chmel
Copy link

Adding my voice to the line as well. We would greatly appreciate this feature to support our pipeline deployments.

@dougclutter
Copy link

We're looking forward to this as well. Our current use case is for Azure DevOps pipelines, but we're also considering it for other long running jobs. Thanks!

@GregJCook
Copy link

Any roadmap updates? We are using private link exclusively across the majority of our Azure footprint and need self hosted runners to deploy our apps. Using VMs is a non-starter and managing an AKS cluster just for runners seems foolish as well. Utilizing ACA seems like the best scenario. Looking forward to not needing several "hacky band aids" to accomplish this.

@VOVELEE
Copy link

VOVELEE commented Apr 11, 2023

Need this as well

@caspeco-dan
Copy link

Any updates regarding this? Would be very useful in our use-case.

@caspeco-dan
Copy link

Any updates regarding this? Would be very useful in our use-case.

Found the answer myself in #526 if someone else is wondering.

@larryclaman
Copy link

larryclaman commented May 24, 2023

BTW, neither @jeffhollan (the OP) or @kendallroden (assignee) are with Microsoft anymore, so I am not sure who is going to close this issue. @anthonychu ?

@vinisoto vinisoto assigned vinisoto and anthonychu and unassigned kendallroden May 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
Feature Requests
Requested Enhancements
Development

No branches or pull requests