title | description | keywords | author | ms.author | manager | ms.date | ms.topic | ms.service | ms.assetid | ROBOTS | audience | ms.devlang | ms.reviewer | ms.suite | ms.tgt_pltfrm | ms.custom |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
rxHadoopCommand function (revoAnalytics) | Microsoft Docs |
Execute arbitrary Hadoop commands and perform standard file operations in Hadoop. |
(revoAnalytics), rxHadoopCommand, rxHadoopCopy, rxHadoopCopyFromLocal, rxHadoopCopyFromClient, rxHadoopCopyToLocal, rxHadoopFileExists, rxHadoopListFiles, rxHadoopMakeDir, rxHadoopMove, rxHadoopRemove, rxHadoopRemoveDir, rxHadoopVersion, file |
chuckheinzelman |
charlhe |
cgronlun |
07/15/2019 |
reference |
mlserver |
Execute arbitrary Hadoop commands and perform standard file operations in Hadoop.
rxHadoopCommand(cmd, computeContext, sshUsername=NULL,
sshHostname=NULL,
sshSwitches=NULL,
sshProfileScript=NULL, intern=FALSE)
rxHadoopCopyFromLocal(source, dest, ...)
rxHadoopCopyFromClient(source, nativeTarget="/tmp", hdfsDest,
computeContext, sshUsername=NULL,
sshHostname=NULL, sshSwitches=NULL, sshProfileScript=NULL)
rxHadoopCopyToLocal(source, dest, ...)
rxHadoopFileExists(path)
rxHadoopListFiles(path="", recursive=FALSE, print, computeContext = rxGetComputeContext(), ...)
rxHadoopMakeDir(path, ...)
rxHadoopMove(source, dest, ...)
rxHadoopCopy(source, dest, ...)
rxHadoopRemove(path, skipTrash=FALSE, ...)
rxHadoopRemoveDir(path, skipTrash=FALSE, ...)
rxHadoopVersion()
A character string containing a valid Hadoop command, that is, the cmd
portion of hadoop cmd
. Embedded quotes are not permitted.
Run against this compute context. Default to the current compute context as returned by rxGetComputeContext .
character string specifying the username for making an ssh connection to the Hadoop cluster.
character string specifying the hostname or IP address of the Hadoop cluster node or edge node that the client will log into for launching Hadoop commands.
character string specifying any switches needed for making an ssh connection to the Hadoop cluster.
Optional character string specifying the absolute path to a profile script that will exist on the sshHostname
host. This is used when the target ssh host does not automatically read in a .bash_profile
, .profile
or other shell environment configuration file for the definition of requisite variables.
logical (not NA
) specifying whether to capture the output of a Hadoop command as an R character vector in a local compute context. (When using the RxHadoopMR
compute context, any output is always returned as an R character vector.)
character vector specifying file(s) to be copied or moved.
character string specifying the destination of a copy or move. If source
includes more than one file, dest
must be a directory.
character string specifying a directory in the Hadoop cluster's native file system, to be used as an intermediate location for file(s) copied from a client machine.
character string specifying a directory in the Hadoop Distributed File System.
character vector specifying location of one or more files or directories.
Deprecation Warning: the print
argument in rxHadoopListFiles
is now deprecated and is going to be removed in the next release. If FALSE
, rxHadoopListFiles
will return a character
vector of paths; by default it prints paths to the console.
logical flag. If TRUE
, directory listings are recursive.
logical flag. If TRUE
, removal via rxHadoopRemove
and rxHadoopRemoveDir
bypasses the trash folder, if one has been set up.
additional arguments to be passed directly to the rxHadoopCommand
function.
rxHadoopCommand
allows you to run basic Hadoop commands. rxCopyFromClient
allows a file to be copied from a remote client to the Hadoop Distributed File System on the
Hadoop cluster. rxHadoopVersion
calls the Hadoop version
command and extracts
and returns the version number only. The remaining functions
are wrappers for various Hadoop file system commands:
-
rxHadoopCopyFromLocal
wraps the Hadoopfs -copyFromLocal
command. -
rxHadoopCopyToLocal
wraps the Hadoopfs -copyToLocal
command. -
rxHadoopListFiles
wraps the Hadoopfs -ls
orfs -lsr
command. -
rxHadoopRemove
wraps the Hadoopfs -rm
command. -
rxHadoopCopy
wraps the Hadoopfs -cp
command. -
rxHadoopMove
wraps the Hadoopfs -mv
command. -
rxHadoopMakeDir
wraps the Hadoopfs -mkdir
command. -
rxHadoopRemoveDir
wraps the Hadoopfs -rm -r
command.
These functions are executed for their side effects and typically return NULL
invisibly.
Microsoft Corporation Microsoft Technical Support
RxHadoopMR.
## Not run:
rxHadoopCommand("version") # should return version information
rxHadoopMakeDir("/user/RevoShare/newUser")
rxHadoopCopyFromLocal("/tmp/foo.txt", "/user/RevoShare/newUser")
rxHadoopRemoveDir("/user/RevoShare/newUser")
## End(Not run)