Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] - IO manager that operates on local file paths example #4094

Open
sryza opened this issue Apr 28, 2021 · 0 comments
Open

[docs] - IO manager that operates on local file paths example #4094

sryza opened this issue Apr 28, 2021 · 0 comments
Assignees
Labels
area: docs Related to documentation in general type: content-gap

Comments

@sryza
Copy link
Contributor

sryza commented Apr 28, 2021

What content is missing

Something like:

@solid(output_defs=[OutputDefinition(metadata={"gcs_path": "/a/b/c"})])
def my_solid(_):
    local_file_name = process_data()
    return local_file_name

class GCSIOManager(IOManager):
    def handle_output(self, context, obj):
        write_local_file_to_gcs(local_file_name=obj, gcs_path=context.metadata["gcs_path"])

    def load_input(self, context):
        local_file_name = make_temporary_file()
        download_gcs_file_to_local(
            local_file_name=local_file_name, gcs_path=context.upstream_output.metadata["gcs_path"]
        )
        return local_file_name

Type of the content

Main Concept: https://docs.dagster.io/concepts/io-management/io-managers#examples

(Optional) Anything in particular you want the docs to cover

(Optional) Target Date

Writer's Guide

  • Docs README
  • Templates to follow:
  • Examples for reference:

Message from the maintainers:

Are you looking for the same documentation content? Give it a 👍. We factor engagement into prioritization.

@sryza sryza added the area: docs Related to documentation in general label Apr 28, 2021
@yuhan yuhan added this to Needs Triage in Docs Content via automation Jun 1, 2021
@yuhan yuhan moved this from Needs Triage to Main Concepts in Docs Content Jun 1, 2021
@yuhan yuhan moved this from Main Concepts to Examples on Main Concepts in Docs Content Jun 1, 2021
@yuhan yuhan assigned yuhan and sryza and unassigned yuhan Jun 7, 2021
@yuhan yuhan moved this from Examples on Main Concepts to In Progress in Docs Content Aug 9, 2021
@sryza sryza moved this from In Progress to Untriaged in Docs Content Dec 21, 2021
@erinkcochran87 erinkcochran87 removed this from Untriaged in Docs Content Jul 14, 2022
@erinkcochran87 erinkcochran87 changed the title [Content Gap] An example of an IO manager that operates on local file paths [docs] - IO manager that operates on local file paths example Sep 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: docs Related to documentation in general type: content-gap
Projects
None yet
Development

No branches or pull requests

2 participants