Skip to content

jina-ai/latency-tracking

main
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
November 11, 2020 08:17
November 4, 2020 08:16

Latency Tracking

Latency Tracking repository works in accordance with scripts/latency-tracking from Jina Core. It benchmarks the following items over the history of releases:

  • import jina time
  • Index Speed
  • Query Speed
  • Average Flow Time
  • DocumentArrayMemmap Extend Time

Jina banner

Blog post: Benchmark a Decentralized Search System on 79 Past Releases

Track Latency

Prepare Environment

This repo can't produce benchmark results independently as it works in accordance with scripts/latency-tracking from Jina Core. So, let's prepare the envrionment at first.

git clone git@github.com:jina-ai/jina.git
cd jina
git clone https://github.com/jina-ai/latency-tracking latency

Run single version

# give the version to benchmark
JINA_VER=master

# benchmark it!
rm -f .dockerignore
docker build --build-arg JINA_VER=$JINA_VER -f latency/Dockerfile -t latency-tracking .
docker run -v $(pwd)/output:/app/output -v $(pwd)/latency/original:/app/original latency-tracking

Run last n versions

Require jq to be installed.

bash latency/batch.sh 5

This will run the last 5 versions in reverse order, i.e. last release first.