[C++][FS][Azure] Implement CreateDir()
#38699
Comments
kou
added a commit
to kou/arrow
that referenced
this issue
Nov 14, 2023
It seems that we can't create a directory explicitly without hierarchical namespace support. It seems that Azure Blob Storage supports only virtual directory. There is no directory. If a file (blob) name has "/", it's treated that the file (blob) exists under a virtual directory. It seems that Azure Data Lake Storage Gen2 supports a real directory. See also: https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-introduction This change chooses the following behavior: * Container can be created with/without hierarchical namespace support. * Directory can be created with hierarchical namespace support. * Directory can't be created without hierarchical namespace support. (`arrow::Status::NotImplemented` is returned for this case.) Azurite doesn't support hierarchical namespace yet. So I can't test the implementation for hierarchical namespace yet. Sorry.
kou
added a commit
that referenced
this issue
Nov 18, 2023
### Rationale for this change It seems that we can't create a directory explicitly without hierarchical namespace support. It seems that Azure Blob Storage supports only virtual directory. There is no directory. If a file (blob) name has "/", it's treated that the file (blob) exists under a virtual directory. It seems that Azure Data Lake Storage Gen2 supports a real directory. See also: https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-introduction ### What changes are included in this PR? This change chooses the following behavior: * Container can be created with/without hierarchical namespace support. * Directory can be created with hierarchical namespace support. * Directory can't be created without hierarchical namespace support. So do nothing without hierachical namespace support. (`arrow::Status::OK()` is just returned.) ### Are these changes tested? Azurite doesn't support hierarchical namespace yet. So I can't test the implementation for hierarchical namespace yet. Sorry. ### Are there any user-facing changes? Yes. * Closes: #38699 Lead-authored-by: Sutou Kouhei <kou@clear-code.com> Co-authored-by: Sutou Kouhei <kou@cozmixng.org> Co-authored-by: Thomas Newton <thomas.w.newton@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
dgreiss
pushed a commit
to dgreiss/arrow
that referenced
this issue
Feb 19, 2024
### Rationale for this change It seems that we can't create a directory explicitly without hierarchical namespace support. It seems that Azure Blob Storage supports only virtual directory. There is no directory. If a file (blob) name has "/", it's treated that the file (blob) exists under a virtual directory. It seems that Azure Data Lake Storage Gen2 supports a real directory. See also: https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-introduction ### What changes are included in this PR? This change chooses the following behavior: * Container can be created with/without hierarchical namespace support. * Directory can be created with hierarchical namespace support. * Directory can't be created without hierarchical namespace support. So do nothing without hierachical namespace support. (`arrow::Status::OK()` is just returned.) ### Are these changes tested? Azurite doesn't support hierarchical namespace yet. So I can't test the implementation for hierarchical namespace yet. Sorry. ### Are there any user-facing changes? Yes. * Closes: apache#38699 Lead-authored-by: Sutou Kouhei <kou@clear-code.com> Co-authored-by: Sutou Kouhei <kou@cozmixng.org> Co-authored-by: Thomas Newton <thomas.w.newton@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the enhancement requested
It's not implemented yet.
This is a child of GH-18014.
Component(s)
C++
The text was updated successfully, but these errors were encountered: