Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task library documentation and structure clean up #3360

Merged
merged 27 commits into from
Sep 22, 2020
Merged

Task library documentation and structure clean up #3360

merged 27 commits into from
Sep 22, 2020

Conversation

joshmeek
Copy link

@joshmeek joshmeek commented Sep 21, 2020

Summary

This PR cleans up the task library documentation and moves around some files that were previously in /contrib.

Changes

  • Removes duplicate task library documentation
  • Adds a small overview and contributing document to the task library docs
  • Deprecates importing task library tasks from /contrib
  • Moves Databricks and MySQL tasks from prefect.contrib.tasks to prefect.tasks (warning raise if imported from old location)

Importance

Task library was missing a true home for documentation. The contrib directory is not useful and it doesn't benefit having some tasks separate from the rest.

Checklist

This PR:

  • adds new tests (if appropriate)
  • adds a change file in the changes/ directory (if appropriate)
  • updates docstrings for any new functions or function arguments, including docs/outline.toml for API reference docs (if appropriate)

@joshmeek joshmeek added docs integrations Related to integrations with other services labels Sep 21, 2020
.flake8 Outdated Show resolved Hide resolved
docs/core/task_library/contributing.md Outdated Show resolved Hide resolved
docs/core/task_library/overview.md Outdated Show resolved Hide resolved
@joshmeek joshmeek linked an issue Sep 21, 2020 that may be closed by this pull request
@PrefectHQ PrefectHQ deleted a comment from codecov bot Sep 22, 2020
@joshmeek joshmeek closed this Sep 22, 2020
@joshmeek joshmeek reopened this Sep 22, 2020
@codecov
Copy link

codecov bot commented Sep 22, 2020

Codecov Report

Merging #3360 into master will increase coverage by 1.76%.
The diff coverage is n/a.

@joshmeek
Copy link
Author

Codecov has been corrected 👍 @jcrist @cicdw

jcrist
jcrist previously approved these changes Sep 22, 2020
Copy link

@jcrist jcrist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall this looks good to me.

.flake8 Outdated
@@ -11,7 +11,7 @@ ignore =
E203,
# Comparing types instead of isinstance
E721,
# Assign a lambda
# Assign a lam\bda
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why not?

jcrist
jcrist previously approved these changes Sep 22, 2020
Copy link
Member

@cicdw cicdw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments - we can merge this as-is and revisit the comments for the full post + as follow-up PRs. In general I think we might want to expand on "design" for tasks (e.g., what to include in init vs run) and maybe provide some examples but this is still a great start

docs/core/task_library/contributing.md Outdated Show resolved Hide resolved
docs/core/task_library/contributing.md Outdated Show resolved Hide resolved
@joshmeek
Copy link
Author

Was just in a conversation with @kingsleyb and I realized we need to document things like our desired pattern for interacting with secrets and also some more information WRT init and run kwargs, stand by

@joshmeek
Copy link
Author

@cicdw @jcrist Made some of the changes that I mentioned above 👍

Copy link
Member

@cicdw cicdw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two small suggestions

docs/core/task_library/contributing.md Outdated Show resolved Hide resolved
docs/core/task_library/contributing.md Outdated Show resolved Hide resolved
joshmeek and others added 2 commits September 22, 2020 17:44
@joshmeek joshmeek merged commit fea6624 into master Sep 22, 2020
@joshmeek joshmeek deleted the tl_post branch September 22, 2020 22:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs integrations Related to integrations with other services
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add databricks to the "task library" in the Core docs
3 participants