Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DSIP-13][Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API #10911

Closed
21 tasks done
Tracked by #14102
xdu-chenrj opened this issue Jul 12, 2022 · 9 comments
Closed
21 tasks done
Tracked by #14102

[DSIP-13][Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API #10911

xdu-chenrj opened this issue Jul 12, 2022 · 9 comments
Assignees
@xdu-chenrj
Labels
DSIP feature new feature Python

Comments

@xdu-chenrj
Copy link
Contributor

xdu-chenrj commented Jul 12, 2022 •
edited

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

  • Decorator implementation
    • A simple Resource plugin that supports local files
    • Local Resource Plugin Refinement
  • GitHub Resource Plugin
    • Private Repository Authentication
    • File Reading
      • Shared Repository File Reading
      • Private Repository File Reading
  • GitLab Resource Plugin
    • Private Authentication
    • File Reading
  • Amazon S3 Resource Plugin
    • Private Authentication
    • File Reading
  • AliCloud OSS Resource Plugin
    • Private Authentication
    • File Reading
  • Other special file reads for different plugins

Use case

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@xdu-chenrj xdu-chenrj added feature new feature Waiting for reply Waiting for reply labels Jul 12, 2022
@github-actions
Copy link

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

  • In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
  • If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

@zhongjiajie zhongjiajie added soc and removed Waiting for reply Waiting for reply labels Jul 12, 2022
@zhongjiajie
Copy link
Member

Same TIPs from #10905 (comment)

@zhongjiajie
Copy link
Member

zhongjiajie commented Jul 12, 2022 •
edited

tests and documents not included in your tasks, it is ok not exists in tasks but I hope you will submit both tests and documents in each task's PR, Specifically how a developer develops a new plugin

@xdu-chenrj
Copy link
Contributor Author

tests and documents not included in your tasks, it is ok not exists in tasks but I hope you will submit both tests and documents in each task's PR, Specifically how a developer develops a new plugin

ok

@zhongjiajie zhongjiajie changed the title [Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API [DSIP-13][Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API Jul 28, 2022
@xdu-chenrj xdu-chenrj mentioned this issue Aug 9, 2022
Merged
@EricGao888
Copy link
Member

@xdu-chenrj I could help with the AliCloud OSS Resource Plugin if you don't mind : )

@EricGao888
Copy link
Member

@xdu-chenrj I could help with the AliCloud OSS Resource Plugin if you don't mind : )

related: #11683

This was referenced Sep 7, 2022
Merged
Closed
Closed
@zhongjiajie
Copy link
Member

maybe we should better follow the DSIP process and introduce this feature to our community

@xdu-chenrj xdu-chenrj mentioned this issue Sep 17, 2022
Merged
@xdu-chenrj xdu-chenrj mentioned this issue Sep 25, 2022
Merged
@zhongjiajie zhongjiajie mentioned this issue Nov 15, 2022
Open
@zhongjiajie
Copy link
Member

already done

@zhongjiajie zhongjiajie mentioned this issue May 15, 2023
Open
47 tasks
@Capricorn0010
Copy link

have a test sample yaml file？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@xdu-chenrj xdu-chenrj

Labels
DSIP feature new feature Python
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@zhongjiajie @EricGao888 @Capricorn0010 @xdu-chenrj