You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Similar to #31418. One of our system test executions failed because it timed out while waiting for the cluster to be created. Increasing the timeout should resolve the issue.
Edit: It happens to another of our system test that uses RedshiftClusterSensor. Somehow, Redshift takes more time now to spin clusters up. Thus, I updated all our system tests using RedshiftClusterSensor to set/increase the timeout.
INFO airflow.task.operators:redshift_cluster.py:64 Poked cluster envfd53fef2-redshift-cluster for status 'available', found status 'creating'
--
ERROR airflow.task:taskinstance.py:1903 Task failed with exception
Traceback (most recent call last):
File "/opt/airflow/airflow/sensors/base.py", line 242, in execute
raise AirflowSensorTimeout(message)
airflow.exceptions.AirflowSensorTimeout: Sensor has timed out; run duration of 901.579888 seconds exceeds the specified timeout of 900.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.
vincbeck
changed the title
AWS system test example_redshift_s3_transfers: increase Redshift timeout
AWS system tests: increase Redshift timeouts
May 25, 2023
It happened this morning to another of our system test that uses RedshiftClusterSensor. Somehow, Redshift takes more time now to spin clusters up. Thus, I updated all our system tests using RedshiftClusterSensor to set/increase the timeout.
It happened this morning to another of our system test that uses RedshiftClusterSensor. Somehow, Redshift takes more time now to spin clusters up. Thus, I updated all our system tests using RedshiftClusterSensor to set/increase the timeout.
Outside the scope of this PR: We should change the default value for that sensor, if the default is doomed to fail with a timeout then it's not a good user experience.
It happened this morning to another of our system test that uses RedshiftClusterSensor. Somehow, Redshift takes more time now to spin clusters up. Thus, I updated all our system tests using RedshiftClusterSensor to set/increase the timeout.
Outside the scope of this PR: We should change the default value for that sensor, if the default is doomed to fail with a timeout then it's not a good user experience.
The default value is actually the default value set by Airflow (1 week), see here. So no need to update the sensor, we were just setting too low timeouts in our system tests
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Similar to #31418. One of our system test executions failed because it timed out while waiting for the cluster to be created. Increasing the timeout should resolve the issue.
Edit: It happens to another of our system test that uses
RedshiftClusterSensor. Somehow, Redshift takes more time now to spin clusters up. Thus, I updated all our system tests usingRedshiftClusterSensorto set/increase the timeout.^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.