Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Connect juicefs to ceph object store without formatting volume? #64

Closed
gtarcoder opened this issue Jan 14, 2021 · 2 comments
Closed

Connect juicefs to ceph object store without formatting volume? #64

gtarcoder opened this issue Jan 14, 2021 · 2 comments
Labels
kind/question Further information is requested

Comments

@gtarcoder
Copy link

The quick start section in https://github.com/juicedata/juicefs says we should format the volume before to do anything, so I am wondering two questions:

  1. can we use juicefs client to communicate with an existing object store and access those already existing data?
  2. if I format volume using an existing object store, will the existing data on that object store be erased?
@davies
Copy link
Contributor

davies commented Jan 14, 2021

Good question.

  1. can we use juicefs client to communicate with an existing object store and access those already existing data?

No. JuiceFS use a block based format to access object store, so existing object can't be accessed. You need to copy it to JuiceFS, so use other solution, for example, S3FS, or Rclone.

  1. if I format volume using an existing object store, will the existing data on that object store be erased?

The format will initialize redis db, and check the permission on object store, just that. Existing objects will NOT be TOUCHed.

@xiaogaozi xiaogaozi added the kind/question Further information is requested label Jan 15, 2021
@gtarcoder
Copy link
Author

Good question.

  1. can we use juicefs client to communicate with an existing object store and access those already existing data?

No. JuiceFS use a block based format to access object store, so existing object can't be accessed. You need to copy it to JuiceFS, so use other solution, for example, S3FS, or Rclone.

  1. if I format volume using an existing object store, will the existing data on that object store be erased?

The format will initialize redis db, and check the permission on object store, just that. Existing objects will NOT be TOUCHed.

Thanks for quick response

davies pushed a commit that referenced this issue Jan 28, 2021
* Return an empty reader when open filesystem directory

* "Fix ReadCloser for Get method of file, sftp hdfs. Add IsDir field for Object struct"

* support sync single object for sftp source

Co-authored-by: chnliyong <liyong@juicedata.io>
davies pushed a commit that referenced this issue Jan 28, 2021
* Return an empty reader when open filesystem directory

* "Fix ReadCloser for Get method of file, sftp hdfs. Add IsDir field for Object struct"

* support sync single object for sftp source

Co-authored-by: chnliyong <liyong@juicedata.io>
davies pushed a commit that referenced this issue Jan 28, 2021
* Return an empty reader when open filesystem directory

* "Fix ReadCloser for Get method of file, sftp hdfs. Add IsDir field for Object struct"

* support sync single object for sftp source

Co-authored-by: chnliyong <liyong@juicedata.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants