Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How should I run task with owner not shell owner in AIRFLOW #7930

Closed
dimberman opened this issue Mar 27, 2020 · 0 comments
Closed

How should I run task with owner not shell owner in AIRFLOW #7930

dimberman opened this issue Mar 27, 2020 · 0 comments
Labels
kind:feature Feature Requests

Comments

@dimberman
Copy link
Contributor

Apache Airflow version:

Kubernetes version (if you are using kubernetes) (use kubectl version):

Environment:

  • Cloud provider or hardware configuration:
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):
  • Install tools:
  • Others:
    What happened:

I dont understand the "owner" in airflow. the comment of ower is "the owner of the task, using the unix username is recommended". I wrote some the following code.

Default_args =
{
'owner': 'max',
'depends_on_past': False,
'start_date': datetime(2016, 7, 14),
'email': ['max@test.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
dag = DAG('dmp-annalect', default_args=default_args,
schedule_interval='30 0 * * *')

task1_pigjob_basedata = """
{local_dir}
/src/basedata/basedata.sh >
{local_dir}
/log/basedata/run_log &
""".format(local_dir=WORKSPACE)

task1_pigjob_basedata = BashOperator(
task_id='task1_pigjob_basedata_impclk',owner='max',
bash_command=pigjob_basedata_impclk,
dag=dag)

I used the command "airflow test dagid taskid 2016-07-20" ,

But I got a error,

...
{bash_operator.py:77}
INFO - put: Permission denied: user=airflow, ....

I thought that my job ran with "max" user, but apperently , ran test using 'airflow' user .

I hope if I run my task using 'max' user, how should I do.

Thanks

What you expected to happen:

How to reproduce it:

Anything else we need to know:

Moved here from https://issues.apache.org/jira/browse/AIRFLOW-357

@mik-laj mik-laj added the kind:feature Feature Requests label Sep 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind:feature Feature Requests
Projects
None yet
Development

No branches or pull requests

2 participants