No description, website, or topics provided.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
basex
doc
evaluation
flinkMLtest
lib
mathosphere-core
mlp
pomlp
restd
.gitignore
.gitmodules
.gitreview
.travis.yml
LICENSE
README.md
checkstyle.xml
config.dev.yaml
mathosphere.properties
pom.xml

README.md

Mathosphere

About

Mathosphere consists of the following components:

  • A baseX ad hock formula search system
  • A flink batch processing system
  • A rest interface

The baseX backend manages the data used for ad hoc retrieval for MathSearch on Wikipedia or DRMF. The rest interface provides an interface for ad hoc retrieval. The MediaWiki MathSearch extension serves as a frontend. The flink batch processing component is used for long running data analysis and batch queries.

Releases and old versions

Currently, there is no Mathosphere release available. Version 3.0.0 is the first version that is going to be released to the public MavenCentral

However, the MathML query generator is available from maven central MavenCentral Note we are using a development version of MathML query generator for this project, under a submodule.

Version 1.0.0-SNAPSHOT is tightly coupled to Stratosphere 0.2.x and was focused on batch formula search. The code is available from (TU-Berlin/mathosphere-history). The research prototype was build explicitly for the NTCIR-10. We demonstrate the principle of separating the challenges of handing huge dadaists from principal question in MIR. See our Querying large Collections of Mathematical Publications paper.

Version 2.0.0-SNAPSHOT is based on Apache Flink. This research prototype analysing fundamental factors of formula similarity is build for the NTCIR-11 conference. See our paper

We are using the NTCIR-11 Wikipedia dataset (specifically the augmentedWikiDump.xml from this host) for as additional training dataset.

Checkout

  • if tests fail on windows make sure to checkout the files with unix-style line endings. This is most easily done by git config --global core.autocrlf false

  • in the git for windows installation process this would be the option #2 Checkout as-is, commit Unix-style line endings Git will not perform any conversion when checking out text files.

Master branch tests

Build Status Coverage Status Known Vulnerabilities

Checkout

if test fail on windows make sure to checkout the files with unix-style line endings. This is most easily done by git config --global core.autocrlf false

(In the git for windows installation process this would be the option #2 Checkout as-is, commit Unix-style line endings Git will not perform any conversion when checking out text files.)

Building this project

Run the following to initialize submodules after cloning this project:

git submodule init
git submodule update

Run the following to pull latest changes from each submodules' repo

git submodule update --remote --merge

Troubleshooting

If test fail due to encoding problems in windows, set the environment variable

JAVA_TOOL_OPTIONS = -Dfile.encoding=UTF8

as suggested on stackoverflow.