Skip to content

defaults_args can't take into method of class instance  #8425

@xiaohan2013

Description

@xiaohan2013

Apache Airflow version: 1.10.9

Kubernetes version (if you are using kubernetes) (use kubectl version):

Environment:

  • Cloud provider or hardware configuration: amazon ec2
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):Linux version 4.14.165-103.209.amzn1.x86_64
  • Install tools:pip3
  • Others:

What happened: pickle _thread.RLock objects

What you expected to happen:

How to reproduce it:
1.
default_args = {
'owner': 'xxx',
'depends_on_past': False,
'start_date': datetime(2020, 4, 6),
'email': ['xxx@xxx.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 0,
'retry_delay': timedelta(minutes=5),
'on_failure_callback': notifier.failure_callback
}
2. notifier = Notifier(subscribers=[Notifier.MSG], phone_receivers="111111111111",
email_receivers="xxxxx@xxxxx.com")

  1. dag = DAG('xxxxxxx',
    default_args=default_args,
    schedule_interval='01 20 * * *')
  2. UI throw exception, pickle _thread.RLock objects ,however in the logfile throwing TypeError: cannot serialize '_io.TextIOWrapper' object

Anything else we need to know:

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind:bugThis is a clearly a bugpending-responsestaleStale PRs per the .github/workflows/stale.yml policy file

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions