Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

restore dagster-aws #78

Closed
bollwyvl opened this issue Oct 31, 2020 · 3 comments
Closed

restore dagster-aws #78

bollwyvl opened this issue Oct 31, 2020 · 3 comments

Comments

@bollwyvl
Copy link
Contributor

bollwyvl commented Oct 31, 2020

As of #77, as it appears the run/test environments for dagster-snowflake and dagster-aws have become unsolveable. Some more careful study of the upstreams is likely required.

@bollwyvl bollwyvl changed the title restore dagster-snowflake restore dagster-snowflake and dagster-aws Oct 31, 2020
This was referenced Feb 5, 2021
@bollwyvl
Copy link
Contributor Author

bollwyvl commented Feb 5, 2021

#100 brings back ❄️, aws was a wash...

@bollwyvl bollwyvl changed the title restore dagster-snowflake and dagster-aws restore dagster-aws Feb 5, 2021
@bollwyvl
Copy link
Contributor Author

bollwyvl commented Nov 4, 2021

It looks like some of the complexity may have been reduced around aws in 0.13.4...

--- a/python_modules/libraries/dagster-aws/setup.py
+++ b/python_modules/libraries/dagster-aws/setup.py
@@ -36,10 +36,10 @@ def get_version() -> str:
             "boto3",
             f"dagster{pin}",
             "packaging",
-            "psycopg2-binary",
             "requests",
         ],
         extras_require={
+            "redshift": ["psycopg2-binary"],
             "pyspark": ["dagster-pyspark"],
             "test": ["moto==1.3.16", "requests-mock"],
         },
diff --git a/python_modules/libraries/dagster-dask/setup.py b/python_modules/libraries/dagster-dask/setup.py
index 75a1fd1..ce514ab 100644
--- a/python_modules/libraries/dagster-dask/setup.py
+++ b/python_modules/libraries/dagster-dask/setup.py
@@ -36,9 +36,6 @@ def get_version() -> str:
             f"dagster{pin}",
             "dask[dataframe]>=1.2.2",
             "distributed>=1.28.1",
-            # resolve issue with aiohttp pin of chardet for aiohttp<=3.7.3, req'd by dask-kubernetes
-            # https://github.com/dagster-io/dagster/issues/3539
-            "chardet<4.0",
         ],
         extras_require={
             "yarn": ["dask-yarn"],

@bollwyvl
Copy link
Contributor Author

bollwyvl commented Apr 8, 2022

closed by #194

@bollwyvl bollwyvl closed this as completed Apr 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant