Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Asakusa Framework
Java Other
Branch: master

Merge pull request #508 from akirakw/wip/doc-yaess-option

Revise yaess document for new cli options.
latest commit d8702df7e0
@akirakw akirakw authored
Failed to load latest commit information.
asakusa-parent Bump up hive version.
build-tools Replace docs URL with `docs.asakusafw.com`.
core-project Fix for checkstyle warning.
development-project Bumped version number to 0.7-SNAPSHOT
directio-project Revise pom.xml of framework projects (#487).
distribution-project Separates sdk.hive.version from hive.version (#489).
dmdl-project Put JavaCC/JFlex versions to the root pom.xml.
docs/ja Merge pull request #508 from akirakw/wip/doc-yaess-option
dsl-project Merge compatibility APIs from `-hadoop{1,2}` branches.
hive-project Use `ByteOrder.LITTLE_ENDIAN` to ser/de Parquet timestamp.
legacy-project Merge pull request #496 from ashigeru/wip/misc/suppress-checkstyle
operation-project Revise pom.xml of framework projects (#487).
sandbox-project Put individual winutils.exe files for x86 and x86_64.
sdk-project Separates sdk.hive.version from hive.version (#489).
testing-project Merge compatibility APIs from `-hadoop{1,2}` branches.
thundergate-project Merge pull request #496 from ashigeru/wip/misc/suppress-checkstyle
utils-project Merge pull request #496 from ashigeru/wip/misc/suppress-checkstyle
windgate-project Make WG ssh data protocol more portable (#492).
yaess-project Merge pull request #496 from ashigeru/wip/misc/suppress-checkstyle
.gitattributes fixed #8. some asakusa-runtime tests fail because of the Windows NewL…
.gitignore Revise .gitignore (#472).
LICENSE Modified license year.
NOTICE License year updated to 2015 (#463).
README.md Merge remote-tracking branch 'root/master' into wip/hadoop-compat-layer
pom.xml Update libraries to recent versions (0.7.0) (#422).

README.md

Asakusa Framework

Asakusa is a Hadoop-based Enterprise Batch Processing Framework, to improve the efficiency of General Enterprise Systems (e.g. Supply Chain Management). Asakusa provides the DAG-based development methodology, which must be required for the large scale batch jobs. With Asakusa, the developers can build up the scalable and robust enterprise batch jobs easily and comprehensively.

Asakusa consists of the following components: (1) Asakusa DSL compiler, (2) a data model generator for Hadoop data format, and (3) integrated test suites tools. Asakusa DSL compiler compiles the DSLs (multi-layered DSLs, business workflow DSL, logic flow DSL, and data operator DSL) into MapReduce programs. The data model generator takes a simple DSL script (data model definition language: DMDL) or RDBMS schema as an input, and generates the Hadoop I/O classes and the corresponding test templates. For the ease of the development, the test suite tools integrate the Asakusa DSL compiler and data model generator.

Resources

How to build

Build for Hadoop 1.x

mvn install [-Phadoop1] [-Dhadoop1.version=1.x.y] -DskipTests

Build for Hadoop 2.x

mvn install -Phadoop2 [-Dhadoop2.version=2.x.y] -DskipTests

How to run tests

  • Install Hadoop with local-mode settings
  • Set hadoop command into your PATH variable, or set it to $HADOOP_CMD
  • And then run mvn test [-Phadoop(1|2)] [-Dhadoop.builtin]

How to import projects into Eclipse

  • Run mvn install eclipse:eclipse [-Phadoop(1|2)] -DskipTests
  • And then import projects from Eclipse

If you run tests in Eclipse, please activate Preferences > Java > Debug > 'Only include exported classpath entries when launching'.

Sub projects

License

Something went wrong with that request. Please try again.