-
Notifications
You must be signed in to change notification settings - Fork 941
Open
Description
I encountered a small issue.
The default S3 prefixes in the AWS Template might not match with the suggested S3 prefixes in metaflow configure aws
MetaflowDataStoreS3Url:
Description: Amazon S3 URL for Metaflow DataStore [METAFLOW_DATASTORE_SYSROOT_S3]
Value: !Sub "s3://${MetaflowS3Bucket}/metaflow"
MetaflowDataToolsS3Url:
Description: Amazon S3 URL for Metaflow DataTools [METAFLOW_DATATOOLS_S3ROOT]
Value: !Sub "s3://${MetaflowS3Bucket}/data"metaflow configure aws suggests metaflow/data as default prefix for METAFLOW_DATATOOLS_S3ROOT if the environment variable METAFLOW_DATATOOLS_S3ROOT isn't set already - what should not be assumed in my opinion.
metaflow/metaflow/cmd/configure_cmd.py
Lines 262 to 265 in 01e52c5
| default=existing_env.get( | |
| "METAFLOW_DATATOOLS_S3ROOT", | |
| os.path.join(env["METAFLOW_DATASTORE_SYSROOT_S3"], "data"), | |
| ), |
Metadata
Metadata
Assignees
Labels
No labels