Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Failed to load latest commit information.
asakusa-parent Fixed to fail build on asakusa-hive-core (#460).
build-tools Revise simple mapreduce engine (#442).
core-project fix for findbugs (#459).
development-project Bumped version number to 0.7-SNAPSHOT
directio-project Clarify error msg on testing w/ Direct I/O (#455).
distribution-project Fixed to fail build on asakusa-hive-core (#460).
dmdl-project Fix documentation comment tags (#450).
docs/ja Release date for version 0.7.2 (#458).
dsl-project Improve performance of testdriver testcases (#452).
hive-project Fixed testcase for Paaquet timestamp (#460).
legacy-project Fixed dependency on legacy-test-dirver (#461).
operation-project Bumped version number to 0.7-SNAPSHOT
sandbox-project Removed legacy autolocal module (#451).
sdk-project Fixed project name (#456)
testing-project Revise information log (#455)
thundergate-project Merge remote-tracking branch 'private/issue/448' into 0.7-develop
utils-project Revise simple mapreduce engine (#442).
windgate-project Merge remote-tracking branch 'private/issue/457' into 0.7-develop
yaess-project Refactoring (#421).
.gitattributes fixed #8. some asakusa-runtime tests fail because of the Windows NewL…
.gitignore Move aggregator to the root
LICENSE Modified license year.
NOTICE Fixed typo.
README.md Revised top-level README file (#420).
pom.xml Update libraries to recent versions (0.7.0) (#422).

README.md

Asakusa Framework

Asakusa is a Hadoop-based Enterprise Batch Processing Framework, to improve the efficiency of General Enterprise Systems (e.g. Supply Chain Management). Asakusa provides the DAG-based development methodology, which must be required for the large scale batch jobs. With Asakusa, the developers can build up the scalable and robust enterprise batch jobs easily and comprehensively.

Asakusa consists of the following components: (1) Asakusa DSL compiler, (2) a data model generator for Hadoop data format, and (3) integrated test suites tools. Asakusa DSL compiler compiles the DSLs (multi-layered DSLs, business workflow DSL, logic flow DSL, and data operator DSL) into MapReduce programs. The data model generator takes a simple DSL script (data model definition language: DMDL) or RDBMS schema as an input, and generates the Hadoop I/O classes and the corresponding test templates. For the ease of the development, the test suite tools integrate the Asakusa DSL compiler and data model generator.

Resources

How to build

mvn install -DskipTests

How to run tests

  • Install Hadoop with local-mode settings
  • Set hadoop command into your PATH variable, or set it to $HADOOP_CMD
  • And run mvn test [-Dhadoop.inprocess]

How to import projects into Eclipse

  • Run mvn install eclipse:eclipse -DskipTests
  • And then import projects from Eclipse

License

Something went wrong with that request. Please try again.