Permalink
Browse files

added new example

  • Loading branch information...
1 parent 3623701 commit 38f8f4ac4291e6d0b709196ad477158fd68c2e6b @cwensel committed Apr 1, 2009
Showing with 107 additions and 0 deletions.
  1. +7 −0 README.txt
  2. +100 −0 data/topic.100.txt
View
@@ -58,6 +58,13 @@ Using
This will compile a new jar, and cut the first fields out of the file 'artists.100.txt'
and save the results to 'output'.
+ For a more complex example:
+
+ > hadoop jar build/multitool.jar source=data/topic.100.txt cut=0 \
+ "pgen=(\b[12][09][0-9]{2}\b)" group=0 count=0 group=1 \
+ sink=output sink.replace=true sink.parts=1
+
+ This will find all years in the input file, count them, and sort them by counts.
Examples
View
@@ -0,0 +1,100 @@
+name id alias article image webpage
+Billy Guy /guid/9202a8c04000641f800000000476cef4 /guid/9202a8c04000641f800000000476cef7
+Samkim /guid/9202a8c04000641f800000000476d336 /guid/9202a8c04000641f800000000476d339
+Institute for the Study of Interdisciplinary Sciences /guid/9202a8c04000641f800000000476d85e /guid/9202a8c04000641f800000000476d861
+Liar (It Takes One to Know One) EP /guid/9202a8c04000641f800000000476d924 /guid/9202a8c04000641f800000000476d927 “Liar (It Takes One to Know One)” cover
+Wye Plantation /guid/9202a8c04000641f800000000476e2dc /guid/9202a8c04000641f800000000476e2df
+Martin Skaroupka /guid/9202a8c04000641f800000000476e3a2 /guid/9202a8c04000641f800000000476e3a5
+Rio Hondo /guid/9202a8c04000641f800000000476e6b0 /guid/9202a8c04000641f800000000476e6b3
+Members of the Northern Ireland Assembly elected in 1998 /guid/9202a8c04000641f800000000476ea4d /guid/9202a8c04000641f800000000476ea50
+Fuse /guid/9202a8c04000641f800000000476eb13 /guid/9202a8c04000641f800000000476eb16 /guid/9202a8c04000641f80000000051db551
+Harlan and Hollingsworth /guid/9202a8c04000641f8000000004769986 /guid/9202a8c04000641f8000000004769989
+Nancy Nord /guid/9202a8c04000641f800000000476ed5b /guid/9202a8c04000641f800000000476ed5e
+Metaphorical extension /guid/9202a8c04000641f800000000476ee21 /guid/9202a8c04000641f800000000476ee24
+Inventory information approval system /guid/9202a8c04000641f800000000476f4d6 /guid/9202a8c04000641f800000000476f4d9
+Requesón /guid/9202a8c04000641f800000000476f9fe /guid/9202a8c04000641f800000000476fa01
+Histoire de M. Vieux Bois /guid/9202a8c04000641f800000000476fc19 /guid/9202a8c04000641f800000000476fc1c Mrux Bois' dream
+Dryandra carlinoides /guid/9202a8c04000641f80000000047708e7 /guid/9202a8c04000641f80000000047708ea Banksia carlinoides,Banksia carlinoides near Eneabba, Western Australia.
+Relocatable Object Module Format /guid/9202a8c04000641f8000000004770eca /guid/9202a8c04000641f8000000004770ecd
+Cockrum's Gray Shrew /guid/9202a8c04000641f800000000477178f /guid/9202a8c04000641f8000000004771792
+Discourse Unit /guid/9202a8c04000641f8000000004771855 /guid/9202a8c04000641f8000000004771858
+Vyacheslav Amin /guid/9202a8c04000641f8000000004771db6 /guid/9202a8c04000641f8000000004771db9
+Creative Loafing Atlanta /guid/9202a8c04000641f8000000004768db3 /guid/9202a8c04000641f8000000004768db6 /guid/9202a8c04000641f80000000080721ca
+Parecis /guid/9202a8c04000641f800000000477274e /guid/9202a8c04000641f8000000004772751
+Battle of Bantry Bay /guid/9202a8c04000641f8000000004768aa5 /guid/9202a8c04000641f8000000004768aa8 Battle of Bantry Bay (1689)
+Cento Fine Foods /guid/9202a8c04000641f8000000004772814 /guid/9202a8c04000641f8000000004772817
+Nat LaCour /guid/9202a8c04000641f8000000004772af1 /guid/9202a8c04000641f8000000004772af4
+Saskatchewan Highway 753 /guid/9202a8c04000641f8000000004772e99 /guid/9202a8c04000641f8000000004772e9c
+Health Realization /guid/9202a8c04000641f8000000004772f3e /guid/9202a8c04000641f8000000004772f41
+Pleasant View /guid/9202a8c04000641f800000000477345b Pleasant View, Colorado /guid/9202a8c04000641f800000000477345e
+Brandywine School /guid/9202a8c04000641f8000000004768516 /guid/9202a8c04000641f8000000004768519 An illustration from Howard Pyle's Book of Pirates (1903) exemplifies the \\"Brandywine School\\" style.
+Nostradamus Ate My Hamster /guid/9202a8c04000641f8000000004773521 /guid/9202a8c04000641f8000000004773524
+Lisa's Song /guid/9202a8c04000641f8000000004767ae6 /guid/9202a8c04000641f8000000004767ae9 Lisa's Song+ 6 Songs cover
+Chuuk football team /guid/9202a8c04000641f8000000004773ed7 /guid/9202a8c04000641f8000000004773eda Shirt badge/Association crest
+Standon Green End /guid/9202a8c04000641f80000000047743f4 Standon Green End, Hertfordshire /guid/9202a8c04000641f80000000047743f7
+BYU Concert Choir /guid/9202a8c04000641f80000000047675a8 /guid/9202a8c04000641f80000000047675ab
+Unity School District /guid/9202a8c04000641f8000000004774907 /guid/9202a8c04000641f800000000477490a /guid/9202a8c04000641f80000000072e2161
+Alexander Aquino /guid/9202a8c04000641f800000000476706a /guid/9202a8c04000641f800000000476706d Mister Philippines is Mister International 2001 /guid/9202a8c04000641f80000000072e135e
+Daniel's Vision of Chapter 8 /guid/9202a8c04000641f8000000004774a9f /guid/9202a8c04000641f8000000004774aa2 Dan8parallel
+Culet /guid/9202a8c04000641f8000000004774b65 /guid/9202a8c04000641f8000000004774b68
+Water supply and sanitation in France /guid/9202a8c04000641f8000000004774c0a /guid/9202a8c04000641f8000000004774c0d
+Australian Centre for Christianity and Culture /guid/9202a8c04000641f8000000004775082 /guid/9202a8c04000641f8000000004775085 ACCC Logo
+Mike McClennan /guid/9202a8c04000641f8000000004775f79 /guid/9202a8c04000641f8000000004775f7c
+Cicero Consulting /guid/9202a8c04000641f8000000004776013 /guid/9202a8c04000641f8000000004776016
+Falcon /guid/9202a8c04000641f8000000004776496 /guid/9202a8c04000641f8000000004776499 /guid/9202a8c04000641f80000000072e241e
+Short-eared Rock-wallaby /guid/9202a8c04000641f8000000004766b4d /guid/9202a8c04000641f8000000004766b50 Shorteared Rock Wallaby,Petrogale brachyotis1
+Lioré et Olivier LeO H.242 /guid/9202a8c04000641f800000000477653b /guid/9202a8c04000641f800000000477653e
+BAE Systems Air Systems /guid/9202a8c04000641f8000000004776601 /guid/9202a8c04000641f8000000004776604
+NPDO /guid/9202a8c04000641f8000000004777427 /guid/9202a8c04000641f800000000477742a
+Linda Marigliano /guid/9202a8c04000641f800000000477794f /guid/9202a8c04000641f8000000004777952
+Io /guid/9202a8c04000641f8000000004777a0a /guid/9202a8c04000641f8000000004777a0d
+Manhunt /guid/9202a8c04000641f8000000004777f81 /guid/9202a8c04000641f8000000004777f84
+Comentarios Reales de los Incas /guid/9202a8c04000641f80000000047780ed /guid/9202a8c04000641f80000000047780f0
+Oracle Data Mining /guid/9202a8c04000641f80000000047781b3 /guid/9202a8c04000641f80000000047781b6 Oracle Data Mining GUI
+Donaldson International Airlines /guid/9202a8c04000641f80000000047786db /guid/9202a8c04000641f80000000047786de Donaldson International Boeing 707 at Prestwick Airport, Scotland,Donaldson International Logo
+Swedish Lapphund /guid/9202a8c04000641f80000000047666ea Lapphund,Svensk Lapphund,Lapplandska Spets,Lapland Spitz /guid/9202a8c04000641f80000000047666ed Svensk lapphund /guid/9202a8c04000641f80000000095206ad
+Jacques van Ypersele de Strihou /guid/9202a8c04000641f8000000004778869 /guid/9202a8c04000641f800000000477886c
+Central at Osborn /guid/9202a8c04000641f800000000477890e /guid/9202a8c04000641f8000000004778911
+Martin Garrick /guid/9202a8c04000641f8000000004778b6c /guid/9202a8c04000641f8000000004778b6f
+Johnny Coppin /guid/9202a8c04000641f80000000047663dc /guid/9202a8c04000641f80000000047663df /guid/9202a8c04000641f80000000072e1245
+Stephen Cochran /guid/9202a8c04000641f8000000004778c32 /guid/9202a8c04000641f8000000004778c35
+Investment Certificate /guid/9202a8c04000641f80000000047798d5 /guid/9202a8c04000641f80000000047798d8
+Expansion ratio /guid/9202a8c04000641f800000000477a6cd /guid/9202a8c04000641f800000000477a6d0
+Rehearsal /guid/9202a8c04000641f800000000477ad99 /guid/9202a8c04000641f800000000477ad9c
+Oregon Ballot Measure 45 /guid/9202a8c04000641f800000000477ae3e /guid/9202a8c04000641f800000000477ae41
+Long Range Surveillance Company /guid/9202a8c04000641f800000000477af04 /guid/9202a8c04000641f800000000477af07
+Sykes Churches Trail /guid/9202a8c04000641f800000000477b5b9 /guid/9202a8c04000641f800000000477b5bc
+Sabi River /guid/9202a8c04000641f800000000477baf7 /guid/9202a8c04000641f800000000477bafa
+Does Anybody Really Know What Time It Is? /guid/9202a8c04000641f80000000047660ce /guid/9202a8c04000641f80000000047660d1
+Sitt al-Bayt /guid/9202a8c04000641f800000000477beaa /guid/9202a8c04000641f800000000477bead Set elbait
+Organization of Lebanese Socialists /guid/9202a8c04000641f800000000477c247 /guid/9202a8c04000641f800000000477c24a
+North Carolina Highway 69 /guid/9202a8c04000641f8000000004765f62 /guid/9202a8c04000641f8000000004765f65
+7th Regiment Indiana Infantry /guid/9202a8c04000641f800000000477c76f /guid/9202a8c04000641f800000000477c772
+1987–1988 United States network television schedule /guid/9202a8c04000641f800000000477c835 1987-1988 United States network television schedule /guid/9202a8c04000641f800000000477c838
+Bleepfest /guid/9202a8c04000641f800000000477cd73 /guid/9202a8c04000641f800000000477cd76
+Post Mortem /guid/9202a8c04000641f800000000477d4fb /guid/9202a8c04000641f800000000477d4fe
+Nidopallium /guid/9202a8c04000641f800000000477d5c1 /guid/9202a8c04000641f800000000477d5c4
+Nutty Mads /guid/9202a8c04000641f800000000477da24 /guid/9202a8c04000641f800000000477da27 Donald the Demon
+Stairway To Heaven/Highway To Hell /guid/9202a8c04000641f800000000477df4c /guid/9202a8c04000641f800000000477df4f Stairway to Heaven/Highway to Hell
+Eastwood Mall /guid/9202a8c04000641f8000000004765c54 /guid/9202a8c04000641f8000000004765c57 Eastwood Mall logo /guid/9202a8c04000641f80000000072e117a
+The Postmodern Life of My Aunt /guid/9202a8c04000641f800000000477e3b9 /guid/9202a8c04000641f800000000477e3bc
+Iota Crucis /guid/9202a8c04000641f800000000477e9a7 /guid/9202a8c04000641f800000000477e9aa
+José Martí and the First International American Conference /guid/9202a8c04000641f8000000004765716 /guid/9202a8c04000641f8000000004765719 José Martí
+2002-03 Sri Lankan cricket season /guid/9202a8c04000641f8000000004765408 /guid/9202a8c04000641f800000000476540b
+I, Thighpaulsandra /guid/9202a8c04000641f800000000477ecaa /guid/9202a8c04000641f800000000477ecad I, Thighpaulsandra cover
+Lois Ruby /guid/9202a8c04000641f800000000477f327 /guid/9202a8c04000641f800000000477f32a
+Calafquén Lake /guid/9202a8c04000641f8000000004764b20 /guid/9202a8c04000641f8000000004764b23
+Candyman /guid/9202a8c04000641f800000000477f59d /guid/9202a8c04000641f800000000477f5a0 \\"Candyman\\" cover
+American Center for Mongolian Studies /guid/9202a8c04000641f800000000477f663 /guid/9202a8c04000641f800000000477f666 Acmslogo /guid/9202a8c04000641f80000000072e2e8f
+PlaneTalk /guid/9202a8c04000641f8000000004764a5a /guid/9202a8c04000641f8000000004764a5d
+Terry Woodgate /guid/9202a8c04000641f800000000476499f /guid/9202a8c04000641f80000000047649a2
+Poa meditative technique /guid/9202a8c04000641f800000000477fafe /guid/9202a8c04000641f800000000477fb01
+Albert Bustamante /guid/9202a8c04000641f800000000477fbc4 /guid/9202a8c04000641f800000000477fbc7 Albert Bustamante
+Francis Hickson Christian /guid/9202a8c04000641f8000000004780031 /guid/9202a8c04000641f8000000004780034
+Jason Shelton /guid/9202a8c04000641f800000000476420e /guid/9202a8c04000641f8000000004764211
+Amory School District /guid/9202a8c04000641f8000000004780178 /guid/9202a8c04000641f800000000478017b
+John Ponsonby, 5th Earl of Bessborough /guid/9202a8c04000641f8000000004764169 /guid/9202a8c04000641f800000000476416c
+Interregional Green Party /guid/9202a8c04000641f800000000478021d /guid/9202a8c04000641f8000000004780220
+Pendula /guid/9202a8c04000641f8000000004780766 /guid/9202a8c04000641f8000000004780769
+Edward Connerton /guid/9202a8c04000641f800000000478080b /guid/9202a8c04000641f800000000478080e
+Culex tritaeniorhynchus /guid/9202a8c04000641f80000000047817d2 /guid/9202a8c04000641f80000000047817d5

0 comments on commit 38f8f4a

Please sign in to comment.