Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING" #15192

Closed
iremonur opened this issue Apr 4, 2021 · 8 comments
Closed

SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING" #15192

iremonur opened this issue Apr 4, 2021 · 8 comments
Labels
affected_version:2.0 Issues Reported for 2.0 area:Scheduler Scheduler or dag parsing Issues kind:bug This is a clearly a bug pending-response stale Stale PRs per the .github/workflows/stale.yml policy file

Comments

@iremonur
Copy link

iremonur commented Apr 4, 2021

Hi,

I am trying to schedule 4 tasks to be 10 minutes between each other, I want the first task to start at 19:20.
In the dag code (located in ~/airflow/dags/example_v6.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 20)
-> schedule_interval= '*/10 * * * *'
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}

I run these commands to schedule the dag:
$ python ~/airflow/dags/example_v6.py
$ airflow db init
$ airflow dags backfill dag_v6 -s 2021-04-04-19:20 -e 2021-04-04-19:50

I got these messages from the terminal:
Screenshot from 2021-04-04 22-44-39

Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.

Environment:

  • GPU : NVIDIA Quadro K3100M
  • OS: Ubuntu 18.04
  • Python 3.7.3

At the UI, the tasks are listed as:
Screenshot from 2021-04-04 22-49-25

I would be very glad if you help me with this.

@iremonur iremonur added the kind:bug This is a clearly a bug label Apr 4, 2021
@boring-cyborg
Copy link

boring-cyborg bot commented Apr 4, 2021

Thanks for opening your first issue here! Be sure to follow the issue template!

@vikramkoka vikramkoka added affected_version:2.0 Issues Reported for 2.0 area:Scheduler Scheduler or dag parsing Issues labels Apr 4, 2021
@parkyo
Copy link

parkyo commented Apr 5, 2021

I found this issue on ovio.org and would love to contribute!

@iremonur
Copy link
Author

iremonur commented Apr 5, 2021

Thank you, it would be great ! Could you share the link related to the issue ?

@iremonur
Copy link
Author

iremonur commented Apr 5, 2021

Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 20.00.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}

I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill tutorial_v2 -s 2021-04-04-19:50 -e 2021-04-06
NOTE: When I run these commands, the date of the database was: 4 April 2021 / 19:57.
Some of the tasks at the beginning are stuck in the state of "running" :
Screenshot from 2021-04-05 10-07-44

I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.

Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.

Environment:

GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3

@hafid-d
Copy link

hafid-d commented May 27, 2021

Any update on this ? Facing the same issue!

@eladkal
Copy link
Contributor

eladkal commented Jan 18, 2022

If someone is experiencing similar issue with latest airflow version please comment and share reproduce steps

@github-actions
Copy link

This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.

@github-actions github-actions bot added the stale Stale PRs per the .github/workflows/stale.yml policy file label Feb 18, 2022
@github-actions
Copy link

This issue has been closed because it has not received response from the issue author.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affected_version:2.0 Issues Reported for 2.0 area:Scheduler Scheduler or dag parsing Issues kind:bug This is a clearly a bug pending-response stale Stale PRs per the .github/workflows/stale.yml policy file
Projects
None yet
Development

No branches or pull requests

5 participants