Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse files

New gem structure

  • Loading branch information...
commit e18ff8537d0df245dff971002d3656d67a4b9373 1 parent 00c5a1e
Philip (flip) Kromer authored
View
5 .document
@@ -0,0 +1,5 @@
+README.textile
+lib/**/*.rb
+examples/**/*.rb
+LICENSE.textile
+docpages/**/*.textile
View
21 README.textile
@@ -2,13 +2,12 @@ h1. Wukong
Wukong makes "Hadoop":http://hadoop.apache.org/core so easy a chimpanzee can use it.
-Treat your dataset as a
-
+Treat your dataset like a
* stream of lines when it's efficient to process by lines
* stream of field arrays when it's efficient to deal directly with fields
* stream of lightweight objects when it's efficient to deal with objects
-Wukong is friends with "Hadoop":http://hadoop.apache.org/core the elephant, "Pig":http://hadoop.apache.org/pig/ the query language, and the @cat@ on your command line. (It's even passing familiar with "martinis":http://datamapper.org and "express trains":http://wiki.rubyonrails.org/rails/pages/ActiveRecord)
+Wukong is friends with "Hadoop":http://hadoop.apache.org/core the elephant, "Pig":http://hadoop.apache.org/pig/ the query language, and the @cat@ on your command line.
The **main documentation** lives on the "Wukong Pages.":http://mrflip.github.com/wukong Please feel free to add supplemental information to the "wukong wiki.":http://wiki.github.com/mrflip/wukong
@@ -24,21 +23,23 @@ h2. Install
** "Main Install and Setup Documentation":http://mrflip.github.com/wukong/INSTALL.html **
-Wukong is still under active development. The newest version is available via "Git":http://git-scm.com on "github:":http://github.com/mrflip/{{ site.gemname }}
-
-pre. $ git clone git://github.com/mrflip/{{ site.gemname }}
+h3. Get the code
-A gem is available from "github:":http://gems.github.com
+We're still actively developing {{ site.gemname }}. The newest version is available via "Git":http://git-scm.com on "github:":http://github.com/mrflip/{{ site.gemname }}
-pre. $ sudo gem install mrflip-{{ site.gemname }} --source=http://gems.github.com
+pre. $ git clone git://github.com/mrflip/{{ site.gemname }}
-or from "gemcutter":http://gemcutter.org
+A gem is available from "gemcutter:":http://gemcutter.org/gems/{{ site.gemname }}
pre. $ sudo gem install {{ site.gemname }} --source=http://gemcutter.org
+(don't use the gems.github.com version -- it's way out of date.)
+
You can instead download this project in either "zip":http://github.com/mrflip/{{ site.gemname }}/zipball/master or "tar":http://github.com/mrflip/{{ site.gemname }}/tarball/master formats.
-To finish setting up, see "setup instructions":http://mrflip.github.com/wukong/INSTALL.html and then read the "usage notes":http://mrflip.github.com/wukong/usage.html
+h3. Dependencies and setup
+
+To finish setting up, see the "detailed setup instructions":http://mrflip.github.com/wukong/INSTALL.html and then read the "usage notes":http://mrflip.github.com/wukong/usage.html
h2. How to write a Wukong script
View
1  VERSION
@@ -0,0 +1 @@
+1.4.0
View
4 VERSION.yml
@@ -1,4 +0,0 @@
----
-:minor: 1
-:patch: 4
-:major: 0
View
23 docpages/INSTALL.textile
@@ -15,25 +15,30 @@ h1(gemheader). {{ site.gemname }} %(small):: install%
h2(#getcode). Get the code
-Wukong is still under active development. The newest version is available via "Git":http://git-scm.com on "github:":http://github.com/mrflip/{{ site.gemname }}
+We're still actively developing {{ site.gemname }}. The newest version is available via "Git":http://git-scm.com on "github:":http://github.com/mrflip/{{ site.gemname }}
pre. $ git clone git://github.com/mrflip/{{ site.gemname }}
-A gem is available from "github:":http://gems.github.com
-
-pre. $ sudo gem install mrflip-{{ site.gemname }} --source=http://gems.github.com
-
-or from "gemcutter":http://gemcutter.org
+A gem is available from "gemcutter:":http://gemcutter.org/gems/{{ site.gemname }}
pre. $ sudo gem install {{ site.gemname }} --source=http://gemcutter.org
+(don't use the gems.github.com version -- it's way out of date.)
+
You can instead download this project in either "zip":http://github.com/mrflip/{{ site.gemname }}/zipball/master or "tar":http://github.com/mrflip/{{ site.gemname }}/tarball/master formats.
+<notextile></div><div class="toggle"></notextile>
+
h3. Get the Dependencies
-* Hadoop, pig
-* extlib, YAML, JSON
-* Optional gems: trollop, addressable/uri, htmlentities
+* Hadoop
+* Pig (optional)
+* Parts of {{ site.gemname }} require these gems:
+** addressable/uri
+** htmlentities
+** extlib
+** YAML
+** JSON
<notextile></div><div class="toggle"></notextile>
View
2  docpages/index.textile
@@ -5,10 +5,8 @@ collapse: true
---
h1(gemheader). wukong %(small):: hadoop made easy%
-
p(description). {{ site.description }}
-
Treat your dataset like a
* stream of lines when it's efficient to process by lines
* stream of field arrays when it's efficient to deal directly with fields
View
64 wukong.gemspec
@@ -5,11 +5,11 @@
Gem::Specification.new do |s|
s.name = %q{wukong}
- s.version = "0.1.4"
+ s.version = "1.4.0"
s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
s.authors = ["Philip (flip) Kromer"]
- s.date = %q{2009-10-05}
+ s.date = %q{2009-10-12}
s.description = %q{ Treat your dataset like a:
* stream of lines when it’s efficient to process by lines
@@ -25,31 +25,7 @@ Gem::Specification.new do |s|
"README.textile"
]
s.files = [
- "doc/INSTALL.textile",
- "doc/LICENSE.textile",
- "doc/README-tutorial.textile",
- "doc/README-wulign.textile",
- "doc/README-wutils.textile",
- "doc/TODO.textile",
- "doc/UsingWukong-part1-setup.textile",
- "doc/UsingWukong-part2-scraping.textile",
- "doc/UsingWukong-part3-parsing.textile",
- "doc/code/api_response_example.txt",
- "doc/code/parser_skeleton.rb",
- "doc/hadoop-nfs.textile",
- "doc/hadoop-setup.textile",
- "doc/index.textile",
- "doc/intro_to_map_reduce/MapReduceDiagram.graffle",
- "doc/links.textile",
- "doc/overview.textile",
- "doc/pig/PigLatinExpressionsList.txt",
- "doc/pig/PigLatinReferenceManual.html",
- "doc/pig/PigLatinReferenceManual.txt",
- "doc/tips.textile",
- "doc/usage.textile",
- "doc/utils.textile",
- "examples/README.txt",
- "examples/and_pig/sample_queries.rb",
+ "examples/README.txt",
"examples/apache_log_parser.rb",
"examples/count_keys.rb",
"examples/count_keys_at_mapper.rb",
@@ -71,28 +47,6 @@ Gem::Specification.new do |s|
"examples/size.rb",
"examples/word_count.rb",
"lib/wukong.rb",
- "lib/wukong/and_pig.rb",
- "lib/wukong/and_pig/README.textile",
- "lib/wukong/and_pig/as.rb",
- "lib/wukong/and_pig/data_types.rb",
- "lib/wukong/and_pig/functions.rb",
- "lib/wukong/and_pig/generate.rb",
- "lib/wukong/and_pig/generate/variable_inflections.rb",
- "lib/wukong/and_pig/junk.rb",
- "lib/wukong/and_pig/operators.rb",
- "lib/wukong/and_pig/operators/compound.rb",
- "lib/wukong/and_pig/operators/evaluators.rb",
- "lib/wukong/and_pig/operators/execution.rb",
- "lib/wukong/and_pig/operators/file_methods.rb",
- "lib/wukong/and_pig/operators/foreach.rb",
- "lib/wukong/and_pig/operators/groupies.rb",
- "lib/wukong/and_pig/operators/load_store.rb",
- "lib/wukong/and_pig/operators/meta.rb",
- "lib/wukong/and_pig/operators/relational.rb",
- "lib/wukong/and_pig/pig_struct.rb",
- "lib/wukong/and_pig/pig_var.rb",
- "lib/wukong/and_pig/symbol.rb",
- "lib/wukong/and_pig/utils.rb",
"lib/wukong/bad_record.rb",
"lib/wukong/boot.rb",
"lib/wukong/datatypes.rb",
@@ -141,7 +95,7 @@ Gem::Specification.new do |s|
"spec/spec_helper.rb",
"wukong.gemspec"
]
- s.homepage = %q{http://github.com/mrflip/wukong}
+ s.homepage = %q{http://mrflip.github.com/wukong}
s.rdoc_options = ["--charset=UTF-8"]
s.require_paths = ["lib"]
s.rubygems_version = %q{1.3.5}
@@ -149,7 +103,6 @@ Gem::Specification.new do |s|
s.test_files = [
"spec/bin/hdp-wc_spec.rb",
"spec/spec_helper.rb",
- "examples/and_pig/sample_queries.rb",
"examples/apache_log_parser.rb",
"examples/count_keys.rb",
"examples/count_keys_at_mapper.rb",
@@ -173,8 +126,17 @@ Gem::Specification.new do |s|
s.specification_version = 3
if Gem::Version.new(Gem::RubyGemsVersion) >= Gem::Version.new('1.2.0') then
+ s.add_runtime_dependency(%q<addressable>, [">= 0"])
+ s.add_runtime_dependency(%q<extlib>, [">= 0"])
+ s.add_runtime_dependency(%q<htmlentities>, [">= 0"])
else
+ s.add_dependency(%q<addressable>, [">= 0"])
+ s.add_dependency(%q<extlib>, [">= 0"])
+ s.add_dependency(%q<htmlentities>, [">= 0"])
end
else
+ s.add_dependency(%q<addressable>, [">= 0"])
+ s.add_dependency(%q<extlib>, [">= 0"])
+ s.add_dependency(%q<htmlentities>, [">= 0"])
end
end
Please sign in to comment.
Something went wrong with that request. Please try again.