A Semantic Web Oracle.
By Eugen Sawin firstname.lastname@example.org.
Pythia is an experimental platform for semantic web search with keyword queries.
The goal is to translate keyword queries, as typically used with full-text search engines, to semantic queries suitable as input for semantic search engines with high confidence.
The hybrid approach combines full-text search and natural language processing to provide the best search experience.
The hybrid approach requires a full-text index and knowledge base.
Currently, the full-text search is conducted via the Google Custom Search API, avoiding the requirement for an index pipeline. Likewise the Freebase API is used for a lightweight access to entity data, in addition to an offline format of the YAGO database.
Due to its huge size, the ontology index is not included in this repository, but will be made available online to allow for reproduction of the system and results.
- POSIX.1b-compliant operating system (support for librt)
- GNU Make
- GNU GCC 4.6+ (
sudo apt-get install build-essential)
- OpenSSL (
sudo apt-get install openssl libssl-dev)
- Python 2.7+ (optional, for style checking)
- SENNA (
make sennaor from http://ml.nec-labs.com/senna)
- POCO C++ Libraries (
make pocoor from http://pocoproject.org)
- gflags (
make gflagsor from http://code.google.com/p/gflags)
- glog (
make glogor from http://code.google.com/p/google-glog)
- Flow (
make flowor from https://github.com/eamsen/flow)
- gtest for testing (http://code.google.com/p/googletest)
- gperftools for profiling (http://code.google.com/p/gperftools)
- cpplint for style checking (
To build all dependencies automatically, use:
Alternatively, you can build each dependency separately by following the instructions here, otherwise you may skip the rest of this section.
The repository contains a slightly modified gflags version with less verbose help output, which is used by default. If you prefer using your installed version, modify the makefile accordingly (follow the comments).
To build to included glog version, use:
Building POCO C++ Libraries
To build the POCO submodule, use:
This will check out the required POCO version from GitHub and build it, which can take a while.
To get the required SENNA version, use:
This will download SENNA from the web (~200MB) and modify the source files, so
that it compiles with
g++. Downloading the files may take a while.
To build the Flow submodule, use:
To build Pythia use:
To build the version optimized for speed (
For debugging, use the debug version:
To start Pythia use:
To show the full usage and flags help use:
Testing (depends on gtest)
To build and run the unit tests use:
Profiling (depends on gperftools)
To build Pythia with profiling turned on use:
Code style checking depends on a modified version of Google's cpplint. Get it via
Checking style (depends on cpplint)
To test code style conformance with the Google C++ Style Guide use:
Pythia - A Semantic Web Oracle.
Copyright (C) 2012, 2013 Eugen Sawin
Pythia is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses.
The full copyright notice is contained in the file COPYING.