lakectl import #4558
lakectl import #4558
Conversation
nopcoder
added
the
include-changelog
| @@ -2168,6 +2168,29 @@ lakectl help [command] [flags] | |||
|
|
|||
|
|
|||
|
|
|||
| ### lakectl import | |||
There was a problem hiding this comment.
Can you also add documentation to https://docs.lakefs.io/setup/import.html#import-data-into-lakefs ?
There was a problem hiding this comment.
@itaiad200 we want to remove the ingest from lakectl in order to have one way to do it?
Currently the "zero copy" import described there is based on the UI capability and the lakectl ingest.
There was a problem hiding this comment.
I don't think so, no. The ingest is leaner and more flexible as it creates uncommitted entries instead of entire commits.
|
|
||
| var importCmd = &cobra.Command{ | ||
| Use: "import --from <object store URI> --to <lakeFS path URI> [--merge]", | ||
| Short: "Import data from external source to an imported branch (with optional merge)", |
There was a problem hiding this comment.
I wonder if "external source" is indicative enough. We can only import from object store paths that the lakeFS server has access to.
There was a problem hiding this comment.
Took it from the docs "The lakectl command supports ingesting objects from an external source. This is done by listing the source bucket (and optional prefix), and creating pointers to the returned objects in lakeFS."
Co-authored-by: itaiad200 <itaiad200@gmail.com>
Co-authored-by: itaiad200 <itaiad200@gmail.com>
Co-authored-by: itaiad200 <itaiad200@gmail.com>
Close #4450