Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
`FileUtils` (incl. seamless cp) for all the other file systems in your life: scp, ssh, s3, hdfs
Ruby
branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
lib
spec
.document
.gitignore
LICENSE
README.mkd
Rakefile
VERSION.yml
moveit.gemspec

README.mkd

moveit

"i like to move it, move it" - Reel 2 Real

FileUtils for all the other file systems in your life: scp, ssh, s3, hdfs The idea is seamless mv and cp between two hosts/formats, and neither of those machines have to be the box running the code (i.e. will ssh if needed and run commands on a remote machine)

status

pre-alpha. what is implemented is functional, but it still falls fall short of the overall goal.

under active development.

requirements

If you want to run the tests:

  • you'll need to be able to ssh into localhost using id_rsa
  • you'll need hadoop setup with the ability to connect to an hdfs server (otherwise the hadoop tests will simply be pending)

friends

(basket)[http://github.com/jashmenn/basket/tree/master]

uses

we have the logfiles in a local folder and we want to put them in hdfs in chunks we have the logfiles in a remote folder and we want to put them in hdfs in chunks we have the logfiles in s3 and we want to put them in a folder in chunks we have the logfiles in s3 and we want to put them in hdfs in chunks

we have the logfiles in hdfs in chunks and we want to run mapred jobs on them we have the results in hdfs in chunks and we want to load them into hive

Copyright

Copyright (c) 2009 Nate Murray, AT&T Interactive

Something went wrong with that request. Please try again.