-
Notifications
You must be signed in to change notification settings - Fork 483
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Nitro Tasks API #1974
Comments
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
Tasks should probably be async, currently the |
If I use a nitro task in, let's say, Netlify will it leverage netlify background functions? |
I'm also interested on this. I would like to have for example my normal code on vercel-edge but run tasks on vercel lambda (5min timeout vs 25 seconds) |
How to disable it, because i use dir tasks for other stuff? |
It is planned to support running these tasks from cli without running the server? |
Nitro already has a CLI preset too! However it is tricky to tell now when we can do support it this way now. |
Any plan for support seconds scheduling? |
@robin-dongbin You mean this https://nitro.unjs.io/guide/tasks#scheduled-tasks or something different? (like a pattern for <1 minute schedule?) |
Yes, that's what I want. Is it possible? I know that cron do not support that, but Laravel has support this last year. |
@pi0 ... I have just tested the experimental scheduled task feature. It works really well! Thanks! Just one question: would it be possible to have a config setting to execute a scheduled task immediately after the cron is scheduled? Example: a task running every 10 minutes: executes once the server starts, and then every 10 minutes after that? I saw in the |
@go4cas Maybe use a Nitro plugin to triger them on startup? (also @robin-dongbin I also wonder if you need to trigger something this frequently, maybe a |
But won’t there be conflicts if a node in a cluster with 8 processes and all 8 processes will cause a task, but this behavior should not happen? It turns out you need to find someone who has a free worker and give him a task from the master? |
For time being, scheduled tasks are not supported in cluster mode the exactly meet this requirement (share a safe lock among them) and it is doable. Regardless inside your interval you can call |
I apologize if this isn't the correct forum. But how is supposed to run those tasks in Nuxt project from CLI? Nuxt CLI will be implemented to invoke those tasks from the URL or we should run directly from nitro cli? |
Yes. |
With async tasks, and enforcing task payloads to be serializable early on it will be possible in the future to dispatch tasks to queues. Shamelessly taking the concept from Laravel: https://laravel.com/docs/10.x/queues The nice thing about that way of working is that when queues are configurable (e.g. redis, some AWS service, etc.) then the dispatch mechanic becomes really usefull for dispatching work to different parts of your architecture. |
|
Hi, do you think in the future this feature could allow us to define scheduled function on gcp as example ? |
@flapili Sure 👍🏼 if you can perhaps share an example project and some links to the docs i can help to do it faster :) (we might need a new preset that auto configured for gcp) |
the usecase we encounter at work is about run every day a routine to check if point of sales are closed, if not send an email, after 6 day force close the POS (constraint from France law) here an example from google directly : https://github.com/firebase/functions-samples/blob/a8b1ab89c503419fab90b0a44b61adee8ec9923b/Node/delete-unused-accounts-cron/functions/index.js#L37 |
I see so we can probably integrate it firebase preset. |
Really cool feature! Works like a charm in VPS environments for scheduledTasks. I have 2 questions: If for example, the nitro app is running in a cluster (e.g. PM2). I am assuming the scheduled tasks will trigger in each instance on the cron schedule? What would you suggest here? Will scheduled tasks hook into platform API's for jobs, e.g. Firebase has scheduled functions and Vercel has Cron Jobs? Both which accept the cron expressions. |
@Eckhardt-D pi0 wrote about cluster mode in this comment: #1974 (comment) |
I don't see in the experimental docs a way to programmatically add/remove tasks, for example, add a task programmatically that executes at a specific time, is that doable? |
By design, no it is not doable to define or modify the tasks in runtime. The reason is that we need deterministic behavior during build to integrate with platform primitives. We can open a way to execute (already defined) tasks btw in runtime, if that's what you might want like @ivanjeremic Can you explain more of the use cases that might require a behavior for add/remove if that was your question? |
@pi0 A use case would be a platform that allows users to add / remove services that in the background add / remove tasks. I have not really good example in mind but maybe something like Hootsuite that allows its users to schedule posts for a specific time for a social media platform. |
@ivanjeremic couldn't you run a job every X minutes that checks if some posts are queued up, then processing them if so? 🤔 |
No. The Hootsuite/Posts example was just an example there are thousends other use cases. |
@manniL I wanted to say I'm new to tasks/cron and maybe the way I think about this problem is wrong, I think you are right and the way you described it is a simpler way of doing what I want. |
Thanks for explaining your idea @ivanjeremic. I think in the future something like this would unblock this and i have added two tasks to tracker. runTask('useTask', {
scheduled: 5 * 60, /* 5 minutes */
multiple: true,
payload: {
userId: 123
}
}) (above snippet is just an example to show the idea) |
Exactly how I imagined it👍🏻 |
It would be handy to disable cron tasks in dev server by default, but keep ability to run it manually. It is annoying when I need to debug something else and see log full of unrelated periodic tasks. It also unnecessary eats battery of laptop. |
It's very nice how the tasks show up in nuxt devtools; I tried to use |
Edit. Turns out i was printing out the return object programatically. |
Thanks for the awesome feature! 🫰 Is there any way to create a new task within a task, or can tasks be created during runtime? |
Do you want to add the ability to run tasks from CLI? Like node .output/server/index.mjs db:migrate or node .output/server/index.mjs task run db:migrate I really liked Nitro but this feature is kinda deal-breaker for me. As I understand, there is no way right now to make such commands because Nitro makes its own entry-point to the app, and I can't add operations before it like I would be able if I used something like express.js, so I can't add CLI |
@AwesomePeregrineFalcon it is in the plan yes to allow CLI interaction with production build. In the meantime you can expose a (protected) API endpoint. |
@TMBL-DEV have you figured this out? 🙂 |
@pi0, I figured out how to make CLI. I made the custom preset. Just used node .output/server/index.mjs server listen and run migrations with node .output/server/index.mjs db migrate But now I have to build the project to use CLI 😞. Anyway, it works now... And I liked everything else in Nitro.js! Is there a reason why there is no possibility to run a custom preset in dev mode? Something like: yarn dev server listen |
Wouldn't it be possible to bind specific tasks to the Task API? For example, it might be a good idea to apply cloudflare worker's email handler or queue handler. While looking at related issues and PRs, I thought it was a good idea and suggested it. |
I just came across the Tasks API and was wondering if eventually it could replace a package like bullmq for simple jobs and a worker type of setup.
Seems to get close to this kind of feature. Or am I somehow misunderstanding it :) |
Hey, does the cron Synatx have support for time zones? I know Croner does. |
@pi0 Is there another way to use Netlify background functions with Nitro to handle multiple instances of a background function? |
Using Nuxt 3. Tried building an endpoint to get scheduled jobs using 'scheduledJobs' variable imported from "cron" package directly, see here: https://croner.56k.guru/usage/examples/#naming-jobs The 'scheduledJobs' variable however returns an empty array always. Is there a way to do this? To monitor scheduled and running jobs? |
Hi @pi0, I'm wondering how scheduled tasks are handled in a serverless context? For example, I am currently using the Firebase preset which uses a Firebase Function as the 'server'. Since the server is not long-lived, would scheduled tasks execute each time the service is called, or are they not included in unsupported presets? |
Nitro tasks allow on-off operations in runtime.
Docs: https://nitro.unjs.io/guide/tasks
Tasks
Tasks
The text was updated successfully, but these errors were encountered: