Airflow migration to modern syntax

[morgante]

We would like a pattern that helps to modernize from older Airflow syntax to modern decorator-based syntax by replacing the DAG call with decorators and bitwise >> chaining with chain().

def do_my_thing() -> DAG:
  dag = DAG(description="My cool DAG")
  
  def do_thing(**context: T.Any) -> bool:
        return not aws_rds.db_exists(
            region=get_variable(EnvVarKeys.TARGET),
            )
   def do_thing_two(**context: T.Any) -> bool:
        pass

  other_operator = ShortCircuitOperator(
        dag=dag,
        task_id='do_db_thing',
        python_callable=do_thing,
        provide_context=True,
     )
  operator_two = PythonOperator(python_callable=do_thing_two)
  
  other_operator \
       >> operator_two

Output:

@dag(description="My cool DAG", schedule_interval=None)
def do_my_thing():
    @task
    def do_thing():
        # You might want to instantiate AwsRDSHook and use it here, or use a specific Airflow provider's hook.
        return not AwsRDSHook().db_exists(
            region=get_variable(EnvVarKeys.TARGET)
        )

    @task
    def do_thing_two():
        pass

    chain(do_thing, do_thing_two)

Acceptance criteria

1. Working pattern that can be applied to handle both cases (in a .md file)
2. At least 5 test cases

[srijan-paul]

I can take this up.

[morgante]

/bounty $150

[algora-pbc]

💎 $150 bounty created by morgante
🙋 If you start working on this, comment /attempt #31 to notify everyone
👉 To claim this bounty, submit a pull request that includes the text /claim #31 somewhere in its body
📝 Before proceeding, please make sure you can receive payouts in your country
💵 Payment arrives in your account 2-5 days after the bounty is rewarded
💯 You keep 100% of the bounty award
🙏 Thank you for contributing to getgrit/python!

[chottuthejimmy]

@morgante Why is this issue still open ?

[morgante]

@morgante Why is this issue still open ?

My mistake.