Skip to content

gavinlxh/twitbase

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

59 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HBase In Action: TwitBase

http://www.manning.com/dimidukkhurana

Compiling the project

Code is managed by maven. Be sure to install maven on your platform before running these commands. Also be aware that HBase is not yet supported on the OpenJDK platform, the default JVM installed on most modern Linux distributions. You'll want to install the Oracle (Sun) Java 6 runtime and make sure it's configured on your $PATH before you continue. Again, on Ubuntu, you may find the oab-java6 utility to be of use.

To build a self-contained jar:

$ mvn package

The jar created using this by default will allow you to interact with HBase running in standalone mode on your local machine. If you want to interact with a remote (possibly fully distributed) HBase deployment, you can put your hbase-site.xml file in the src/main/resources directory before compiling the jar.

Using TwitBase

We have provided a launcher script to run TwitBase and the utilities that the HBaseIA project comes with.

$ bin/launcher

Just run the launcher without any arguments and it'll print out the usage information.

TwitBase applications can also be run using java directly:

$ java -cp target/twitbase-1.0.0.jar <app> [options...]

Utilities for interacting with TwitBase include:

  • HBaseIA.TwitBase.InitTables : create TwitBase tables
  • HBaseIA.TwitBase.TwitsTool : tool for managing Twits
  • HBaseIA.TwitBase.UsersTool : tool for managing Users
  • HBaseIA.TwitBase.LoadUsers : tool for loading random Users
  • HBaseIA.TwitBase.LoadTwits : tool for loading random Twits

The following MapReduce jobs can be launched the same way:

  • HBaseIA.TwitBase.mapreduce.TimeSpent : run TimeSpent log processing MR job
  • HBaseIA.TwitBase.mapreduce.CountShakespeare : run Shakespearean counter MR job
  • HBaseIA.TwitBase.mapreduce.HamletTagger : run hamlet-tagging MR job

Other utilities and scripts

The following utilities are available for you to play with:

  • utils.TablePreSplitter : create pre-split table

License

Copyright (C) 2012 Nick Dimiduk, Amandeep Khurana

Distributed under the Apache License, version 2.0, the same as HBase.

About

TwitBase is a running example used throughout HBase In Action

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published