Vespa - the open big data serving engine
Switch branches/tags
vespa-6.286.54-1 vespa-6.285.17-1 vespa-6.284.14-1 vespa-6.282.83-1 vespa-6.281.43-1 vespa-6.280.15-1 vespa-6.279.46-1 vespa-6.278.1-1 vespa-6.277.15-1 vespa-6.276.19-1 vespa-6.274.30-1 vespa-6.271.25-1 vespa-6.269.2-1 vespa-6.268.1-1 vespa-6.267.49-1 vespa-6.266.22-1 vespa-6.265.30-1 vespa-6.264.15-1 vespa-6.263.46-1 vespa-6.262.3-1 vespa-6.259.36-1 vespa-6.258.8-1 vespa-6.257.14-1 vespa-6.255.2-1 vespa-6.254.16-1 vespa-6.252.3-1 vespa-6.251.16-1 vespa-6.250.10-1 vespa-6.249.9-1 vespa-6.248.120-1 vespa-6.247.2-1 vespa-6.246.92-1 vespa-6.245.70-1 vespa-6.244.127-1 vespa-6.243.159-1 vespa-6.242.39-1 vespa-6.241.65-1 vespa-6.240.88-1 vespa-6.235.43-1 vespa-6.234.71-1 vespa-6.233.17-1 vespa-6.232.4-1 vespa-6.231.18-1 vespa-6.230.174-1 vespa-6.229.8-1 vespa-6.228.142-1 vespa-6.227.36-1 vespa-6.226.445-1 vespa-6.225.3-1 vespa-6.224.75-1 vespa-6.223.147-1 vespa-6.222.24-1 vespa-6.221.26-1 vespa-6.220.20-1 vespa-6.219.12-1 vespa-6.218.63-1 vespa-6.217.11-1 vespa-6.216.133-1 vespa-6.215.9-1 vespa-6.214.72-1 vespa-6.213.147-1 vespa-6.212.47-1 vespa-6.211.26-1 vespa-6.210.41-1 vespa-6.209.26-1 vespa-6.208.4-1 vespa-6.207.23-1 vespa-6.206.147-1 vespa-6.205.22-1 vespa-6.204.21-1 vespa-6.203.29-1 vespa-6.202.135-1 vespa-6.201.10-1 vespa-6.200.24-1 vespa-6.199.105-1 vespa-6.198.37-1 vespa-6.197.154-1 vespa-6.196.148-1 vespa-6.195.55-1 vespa-6.194.21-1 vespa-6.193.124-1 vespa-6.192.4 vespa-6.192.4-1 vespa-6.191.14 vespa-6.191.14-1 vespa-6.189.17-1 vespa-6.188.3-1 vespa-6.187.27-1 vespa-6.186.84-1 vespa-6.185.9-1 vespa-6.184.43-1 vespa-6.183.169 vespa-6.183.169-1 vespa-6.182.28-1 vespa-6.181.23-1 vespa-6.179.30-1 vespa-6.178.22-1 vespa-6.177.31-1 vespa-6.176.233-1 vespa-6.175.31-1
Nothing to show
Clone or download
bratseth Merge pull request #7002 from vespa-engine/balder/improve-invalid-tex…
…t-detection

Ensure that you can not trick invalid characters past the text verifi…
Latest commit 5ae62ae Sep 19, 2018
Permalink
Failed to load latest commit information.
annotations Replace 'tonytv' with full name in author tags Jul 5, 2018
application-deploy-plugin Remove explicit versions - inherit from parent. Jun 29, 2018
application-model Remove explicit maven-compiler-plugin config. Inherit from parent. Apr 25, 2018
application-preprocessor update bootstrap May 16, 2018
application Exclude langauge-detector from container-dev Jul 24, 2018
athenz-identity-provider-service Fix Jetty NPE Sep 13, 2018
bundle-plugin-test Enable and fix test to verify bundle version. Sep 13, 2018
bundle-plugin Rename config param to attach bundle artifact Aug 24, 2018
chain Java 9: Class.newInstance() is deprecated. May 3, 2018
clustercontroller-apps Only derive default bucket space node states when cluster has global … May 2, 2018
clustercontroller-apputil Remove explicit maven-compiler-plugin config. Inherit from parent. Apr 25, 2018
clustercontroller-core set-node-state timeout in CC Jun 22, 2018
clustercontroller-standalone update bootstrap May 16, 2018
clustercontroller-utils Move timeout query param parsing out of JsonReader Jun 25, 2018
component Replace 'tonytv' with full name in author tags Jul 5, 2018
config-application-package Revert "Merge pull request #6635 from vespa-engine/bratseth/generate-… Aug 21, 2018
config-bundle Remove Scala remnants from Maven build files Jun 25, 2018
config-class-plugin Replace 'tonytv' with full name in author tags Jul 5, 2018
config-lib Read fiel distribution file reference correctly Sep 7, 2018
config-model-api Revert "Merge pull request #6742 from vespa-engine/revert-6732-bratse… Aug 30, 2018
config-model-fat Remove unnecessary dependencies. Jun 26, 2018
config-model Warn on deprecated 'metric-consumers' in services.xml. Sep 19, 2018
config-provisioning Merge with master Sep 18, 2018
config-proxy Use shade plugin instead of assembly. Sep 12, 2018
config Enhance array detection to avoid detecting .[document]. as an array. Sep 12, 2018
config_test Add copyright header Oct 27, 2017
configd Merge pull request #6639 from vespa-engine/arnej/delay-crash-loops-more Aug 21, 2018
configdefinitions Revert "Bratseth/handle large constants take 3" Sep 5, 2018
configgen Scala code replaced with Java equivalent May 24, 2018
configserver Fixed pattern order in getBindingMatch. Added test Sep 19, 2018
configutil clean up remnants of .mak files Jun 11, 2018
container-accesslogging Merge pull request #6837 from vespa-engine/arnej/add-retention-enforcer Sep 10, 2018
container-core Merge pull request #6977 from vespa-engine/gjoranv/remove-linguistics… Sep 19, 2018
container-dependencies-enforcer Update jackson to 2.8.11 and jackson-databind to 2.8.11.2 Sep 19, 2018
container-dependency-versions Update jackson to 2.8.11 and jackson-databind to 2.8.11.2 Sep 19, 2018
container-dev Rename (#6543) Aug 10, 2018
container-di Nonfunctional changes only Sep 5, 2018
container-disc Use correct version for jackson-databind preinstall jar. (#7015) Sep 19, 2018
container-integration-test Add missing newline. Jul 12, 2018
container-jersey2 Replace 'tonytv' with full name in author tags Jul 5, 2018
container-messagebus Replace 'tonytv' with full name in author tags Jul 5, 2018
container-search-and-docproc Split parent + container-dependency-versions from root pom. Dec 1, 2017
container-search-gui Solved conflict between files Jul 19, 2018
container-search Merge pull request #6967 from vespa-engine/ollivir/move-logic-to-fs4c… Sep 19, 2018
container-test-jars Remove Scala remnants from Maven build files Jun 25, 2018
container-test Jdisc provides bouncycastle now, so don't hide it. Mar 7, 2018
container Remove aries.spifly and asm-debug-all. Jun 6, 2018
controller-api Replace HTTP response with Log class. Other cleanup Sep 18, 2018
controller-server Replace HTTP response with Log class. Other cleanup Sep 18, 2018
defaults reorder to get all defaults in the same place Jul 19, 2018
dist Use llvm 7 on Fedora 29 and Fedora 30. Aug 29, 2018
docker-api Handle null network stats Sep 11, 2018
docker Fixed typo in environment variable assignment Mar 26, 2018
docproc Revert "Revert "Revert "Do not expose fieldupdates as a list. Hide im… Sep 18, 2018
docprocs Revert "Revert "Revert "Do not expose fieldupdates as a list. Hide im… Sep 18, 2018
document Update the test to reflect stricter text input validation. Sep 19, 2018
documentapi Send global constants Sep 6, 2018
documentgen-test Make the example legal Sep 14, 2018
eval Merge pull request #6518 from vespa-engine/havardpe/avoid-old-style-v… Aug 8, 2018
fastlib add and use HDR_ABORT instead Jun 20, 2018
fastos clean up remnants of .mak files Jun 11, 2018
fat-model-dependencies Include model evaluation Aug 31, 2018
fbench Use fallthrough attributes. May 27, 2018
fileacquirer Use fileAcquirer Sep 10, 2018
filedistribution Set MaxJavaStackTraceDepth to a value legal for all JVM versions. Jul 5, 2018
fnet re-enable fnet tls tests Sep 17, 2018
fsa clean up remnants of .mak files Jun 11, 2018
indexinglanguage Revert "Revert "Revert "Do not expose fieldupdates as a list. Hide im… Sep 18, 2018
jaxrs_client_utils Avoid set-node-state retry Jun 14, 2018
jaxrs_utils Split parent + container-dependency-versions from root pom. Dec 1, 2017
jdisc-security-filters Replace use of com.yahoo.vespa.athenz.tls with com.yahoo.security Sep 5, 2018
jdisc_core Add jaxb-core and jaxb-impl dependencies and export their packages. Jul 10, 2018
jdisc_core_test Fix author tag for Simon Jul 5, 2018
jdisc_http_service Make SslContextFactoryProvider public api Sep 13, 2018
jdisc_jetty Remove aries.spifly and asm-debug-all. Jun 6, 2018
jdisc_messagebus_service Nonfunctional changes only Sep 7, 2018
jrt Use TlsCryptoEngine if VESPA_TLS_CONFIG_FILE is set Sep 10, 2018
jrt_test remove non-instant invocation Sep 5, 2018
juniper Remove some unused code Aug 31, 2018
libmlr update bootstrap May 16, 2018
linguistics Defer loading the huge optimaize knowledgepool until you really need … Sep 10, 2018
logd add some comments, adjust timestamp extension Sep 10, 2018
logforwarder forgot terminating nullptr Jul 27, 2018
logserver Remove unused dependencies Sep 11, 2018
lowercasing_test Update copyright headers Jun 14, 2017
maven-plugins Move two Manven plugins to the maven-plugins module so they are compi… Jul 11, 2018
messagebus-disc Update maven-javadoc-plugin config to use 3.0 syntax. May 14, 2018
messagebus Remove unused and deprecated error code Sep 13, 2018
messagebus_test clean up remnants of .mak files Jun 11, 2018
metrics Remove declaration of unused plugin. Aug 24, 2018
model-evaluation Merge pull request #6981 from vespa-engine/lesters/add-model-eval-res… Sep 18, 2018
node-admin Operate on byte array Sep 17, 2018
node-maintainer Close response and client Aug 28, 2018
node-repository Log reason for removal of node Sep 19, 2018
orchestrator-restapi Add / fix @author Mar 14, 2018
orchestrator Replace 'tonytv' with full name in author tags Jul 5, 2018
parent Revert "Upgrade to Curator 2.12.0" Aug 31, 2018
persistence Support concurrent get/iterate/createIterator in dummy persistence Jul 12, 2018
persistencetypes clean up remnants of .mak files Jun 11, 2018
predicate-search-core Fix author tag for Simon Jul 5, 2018
predicate-search Remove usage of junit.framework Apr 30, 2018
processing Install model-evaluation in standalone Aug 28, 2018
protocols Remove never used per storage node ops latencies in host info. Mar 13, 2018
provided-dependencies Jdisc provides bouncycastle now, so don't hide it. Mar 7, 2018
searchcommon Grow destination array again if it is still too small. Sep 6, 2018
searchcore Must wait longer than stats update interval. Sep 19, 2018
searchcorespi Remove whitespace Aug 12, 2018
searchlib Merge pull request #6984 from vespa-engine/balder/increase-interval-f… Sep 19, 2018
searchsummary shared_ptr -> unique_ptr Aug 28, 2018
service-monitor Simplify HealthClient by using ServiceIdentitySslSocketFactory Aug 14, 2018
serviceview Cleanup Mar 6, 2018
simplemetrics Add bundle Aug 30, 2018
slobrok remove non-instant invocation Sep 5, 2018
socket_test Fix author tag for Simon Jul 5, 2018
staging_vespalib Order by anonymous rss Sep 5, 2018
standalone-container Temporarily disable setting hosted property for config servers Sep 13, 2018
statistics Replace 'tonytv' with full name in author tags Jul 5, 2018
storage remove non-instant invocation Sep 5, 2018
storageapi Remove whitespace Aug 12, 2018
storageframework Remove stringref::c_str() Jul 25, 2018
storageserver move LOG_SETUP after other includes Jun 20, 2018
streamingvisitors Pass stringref by value Aug 10, 2018
tenant-base Address review Sep 19, 2018
tenant-cd Add modules for open-source hosted applications Sep 19, 2018
testutil Support file templates Jan 27, 2018
travis Print maven (and java) version. Aug 31, 2018
vagrant Merge pull request #6983 from vespa-engine/bjorncs/vagrant Sep 17, 2018
vbench clean up remnants of .mak files Jun 11, 2018
vdslib Remove declaration of unused plugin. Aug 24, 2018
vdstestlib clean up remnants of .mak files Jun 11, 2018
vespa-application-maven-plugin Replace 'tonytv' with full name in author tags Jul 5, 2018
vespa-athenz Revert "Replace RSA with EC in unit test" Sep 12, 2018
vespa-documentgen-plugin Don't build rank profiles when generating document Java classes Sep 18, 2018
vespa-hadoop Do NOT specify custom version of maven plugins in child modules. May 3, 2018
vespa-http-client Inherit apache httpcomponents version from parent. Jul 18, 2018
vespa_feed_perf Fix author tag for Simon Jul 5, 2018
vespa_fsa Publish Jun 15, 2016
vespa_jersey2 Split parent + container-dependency-versions from root pom. Dec 1, 2017
vespa_qrs Publish Jun 15, 2016
vespabase Install valgrind suppressions file. Aug 1, 2018
vespaclient-container-plugin Revert "Revert "Revert "Do not expose fieldupdates as a list. Hide im… Sep 18, 2018
vespaclient-core Revert "Revert "Balder/again when time is up it is up"" Feb 5, 2018
vespaclient-java Set MaxJavaStackTraceDepth to a value legal for all JVM versions. Jul 5, 2018
vespaclient Revert "Revert "Explicitly use legacy format option to vespa-get-conf… Sep 4, 2018
vespajlib Ensure that you can not trick invalid characters past the text verifi… Sep 19, 2018
vespalib drain as much as possible before reading more socket data Sep 17, 2018
vespalog enforce log retention policies Sep 6, 2018
vespamalloc If there are intermediate errors that has no effect on the end result… Sep 7, 2018
vsm Ignore attributecombiner rewriter for streaming search. Sep 7, 2018
yolean Fix author tag for Simon Jul 5, 2018
zkfacade Remove deprecated and unused constructor Sep 13, 2018
.gitignore Ignore clion files. Oct 6, 2017
.travis.yml Don't delete com.yahoo.athenz artifacts Nov 7, 2017
CMakeLists.txt Add the model evaluation module Aug 27, 2018
CONTRIBUTING.md Add copyright header Oct 27, 2017
LICENSE Publish Jun 15, 2016
OWNERS Publish Jun 15, 2016
README-cmake.md Add copyright header Oct 27, 2017
README.md Update 'build environment' section in main README Jul 12, 2018
TODO.md Add copyright header Oct 27, 2017
VERSION Enable new storage api protocol serialization. May 4, 2018
bootstrap-cmake.sh Reduce duplication in cmake command args. Sep 17, 2018
bootstrap-cpp.sh Add option to setup unprivileged compilation of Vespa. Sep 14, 2018
bootstrap.sh Maven install plugin fails when multiple maven plugins are installed … Jul 18, 2018
build_settings.cmake Default now 6.0 unless set explicit. Aug 12, 2018
cppunit-parallelize.py Update copyright headers Jun 14, 2017
dist.sh Set version number when building Vespa RPM. Bump minor number in VERS… Aug 28, 2018
empty.cpp Publish Jun 15, 2016
functions.cmake Install valgrind suppressions file. Aug 1, 2018
pom.xml Add modules for open-source hosted applications Sep 19, 2018
valgrind-suppressions.txt Suppress memory leak in setenv. Jun 7, 2018
vtag.cmake Update copyright headers Jun 14, 2017

README.md

Vespa

Vespa is an engine for low-latency computation over large data sets. It stores and indexes your data such that queries, selection and processing over the data can be performed at serving time.

This README describes how to build and develop the Vespa engine. To get started, read the quick start, or find the full documentation at http://docs.vespa.ai/.

Code licensed under the Apache 2.0 license. See LICENSE for terms.

Travis-CI build status: Build Status

Get started developing

Setup build environment

C++ and Java building is supported on CentOS 7. The Java source can also be built on any platform having Java 8 and Maven installed. We recommend using the following environment: Create C++ / Java dev environment on CentOS using VirtualBox and Vagrant. You can also setup CentOS 7 natively and install the following build dependencies:

sudo yum-config-manager --add-repo https://copr.fedorainfracloud.org/coprs/g/vespa/vespa/repo/epel-7/group_vespa-vespa-epel-7.repo
sudo yum -y install epel-release centos-release-scl yum-utils
sudo yum -y install ccache \
    rpm-build
yum-builddep -y <vespa-source>/dist/vespa.spec

Build Java modules

export MAVEN_OPTS="-Xms128m -Xmx1024m"
source /opt/rh/rh-maven35/enable
bash bootstrap.sh java
mvn -T <num-threads> install

Build C++ modules

Replace <build-dir> with the name of the directory in which you'd like to build Vespa. Replace <source-dir> with the directory in which you've cloned/unpacked the source tree.

bash bootstrap-cpp.sh <source-dir> <build-dir>
cd <build-dir>
make -j <num-threads>
ctest3 -j <num-threads>

Create RPM packages

sh dist.sh VERSION && rpmbuild -ba ~/rpmbuild/SPECS/vespa-VERSION.spec

Run Vespa on a local machine

A basic, single-node install is found in the quick start. For multi-node and using Node Admin, read node-admin/README.md.

Write documentation

Update user documentation at https://github.com/vespa-engine/documentation