Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HttpFS / WebHDFS support #29

Closed
Antwnis opened this issue Jan 31, 2016 · 1 comment
Closed

HttpFS / WebHDFS support #29

Antwnis opened this issue Jan 31, 2016 · 1 comment

Comments

@Antwnis
Copy link

Antwnis commented Jan 31, 2016

Sometimes we want to operate over remote hadoop clusters. That can be achieved - through REST calls to HttpFS / WebHDFS.

The only difference between the 2 services above - is that i) they listen on different ports ii) HttpFS is minimizing the footprint required to access HDFS, as a single node acts as a "gateway" where WebHDFS requires access to all nodes of the cluster

Introduce capabilities over functionalities:

File and Directory Operations
Create and Write to a File
Append to a File
Open and Read a File
Make a Directory
Rename a File/Directory
Delete a File/Directory
Status of a File/Directory
List a Directory

Other File System Operations
Get Content Summary of a Directory
Get File Checksum
Get Home Directory
Set Permission
Set Owner
Set Replication Factor
Set Access or Modification Time

@sksamuel
Copy link
Contributor

We could add a remote component but the perf would be terrible?

@sksamuel sksamuel closed this as completed Mar 8, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants