Skip to content

Latest commit

 

History

History

java-client

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 

Pegasus Java Client

Development

1. Prepare

cd scripts && bash recompile_thrift.sh

2. Format the code

mvn spotless:apply

3. Build

mvn clean package -DskipTests

4. Test

To run test, you should prepare the test environment:

  1. Start Pegasus onebox
  2. Install some necessary tools, such as net-tools
mvn clean package

Or specify one test:

mvn clean package -Dtest=TestPing

Using Pegasus Java client

Install

cd scripts && bash recompile_thrift.sh && cd -
mvn clean install -DskipTests

Configuration

Configure client by pegasus.properties file, for example:

meta_servers = 127.0.0.1:34601,127.0.0.1:34602,127.0.0.1:34603
operation_timeout = 1000
async_workers = 4
enable_perf_counter = true
perf_counter_tags = k1=v1,k2=v2,k3=v3
push_counter_interval_secs = 10

You can provide a parameter of configPath when creating a client instance.

The format of configPath should be one of these:

  • zk path: zk://host1:port1,host2:port2,host3:port3/path/to/config
  • local file path: file:///path/to/config
  • resource path: resource:///path/to/config

PerfCounter (Metrics)

Pegasus Java Client supports QPS and latency statistics of requests.

The related configurations are:

enable_perf_counter = true
perf_counter_tags = k1=v1,k2=v2,k3=v3
push_counter_interval_secs = 10

For each type of request(get, set, multiset, etc.), we collect 8 metrics:

  1. cps-1sec: the request's qps
  2. cps-1min: the request's queries per 1 minute
  3. cps-5min: the request's queries per 5 minutes
  4. cps-15min: the request's queries per 15 minutes
  5. latency-p50: the moving median of request's queries
  6. latency-p99: the moving p99 of request's queries
  7. lantecy-p999: the moving p999 of request's queries
  8. latency-max: the moving max of request's queries

We use io.dropwizard.metrics library to calculate the request count.

Currently, metrics are integrated with open-falcon(https://open-falcon.org/),

which push counters to local http agent http://127.0.0.1:1988/push/v1.

If you'd like to integrate pegasus client with other monitor system, please let us know ASAP.