Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to run AWS Batch Jobs? #8

Closed
ogoid opened this issue May 29, 2021 · 3 comments
Closed

Is it possible to run AWS Batch Jobs? #8

ogoid opened this issue May 29, 2021 · 3 comments

Comments

@ogoid
Copy link

ogoid commented May 29, 2021

For longer running tasks, or which may require GPU or more resources, AWS Lambda functions may not be sufficient.

Is orkestra's current architecture capable of generating and dispatching AWS Batch job definitions? How hard would it be to implement such capability?

I suppose the Batch environment setup (job queue etc.) could be left to the user. orkestra could act more as generator for Step Functions definitions.

@knowsuchagency
Copy link
Owner

Although I haven't yet tested, it should be possible to compose a batch task at the CDK layer like in this example.

I'll try it out and throw an example up soon.

@ogoid
Copy link
Author

ogoid commented May 29, 2021

I'd love an example, thanks. I have no experience with Python's CDK version and am still trying to understand how it all works.

Basically I'm looking for a workflow library integrated with AWS API Gateway/Lambda, Batch and Step Functions, so orkestra seems very promising.

@knowsuchagency
Copy link
Owner

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants