jashmenn / moveit
- Source
- Commits
- Network (1)
- Issues (0)
- Downloads (0)
- Wiki (1)
- Graphs
-
Branch:
master
`FileUtils` (incl. seamless cp) for all the other file systems in your life: scp, ssh, s3, hdfs
| name | age | message | |
|---|---|---|---|
 |
.document | Loading commit data...  |
|
| |
.gitignore | ||
| |
LICENSE | ||
| |
README.mkd | ||
| |
Rakefile | ||
| |
VERSION.yml | ||
 |
lib/ | ||
| |
moveit.gemspec | ||
| |
spec/ |
moveit
"i like to move it, move it" - Reel 2 Real
FileUtils for all the other file systems in your life: scp, ssh, s3, hdfs
The idea is seamless mv and cp between two hosts/formats, and neither of those machines have to be the box running the code (i.e. will ssh if needed and run commands on a remote machine)
status
pre-alpha. what is implemented is functional, but it still falls fall short of the overall goal.
under active development.
requirements
If you want to run the tests:
you'll need to be able to ssh into localhost using id_rsa
you'll need hadoop setup with the ability to connect to an hdfs server (otherwise the hadoop tests will simply be pending)
friends
(basket)[http://github.com/jashmenn/basket/tree/master]
uses
we have the logfiles in a local folder and we want to put them in hdfs in chunks we have the logfiles in a remote folder and we want to put them in hdfs in chunks we have the logfiles in s3 and we want to put them in a folder in chunks we have the logfiles in s3 and we want to put them in hdfs in chunks
we have the logfiles in hdfs in chunks and we want to run mapred jobs on them we have the results in hdfs in chunks and we want to load them into hive
Copyright
Copyright (c) 2009 Nate Murray, AT&T Interactive
