Parallel processing plugin for jug
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
R
inst
man
var
.Rbuildignore
.gitignore
DESCRIPTION
NAMESPACE
README.md
jug.parallel.Rproj

README.md

jug.parallel

under development

jug.parallel allows processing jug requests in parallel. Under the hood it launches a node.js based load balancer which in turn spins up n different instances of your jug instance. A round-robin approach is used to distribute the requests.

Requirements

  • node.js installation

Installation

devtools::install_github("Bart6114/jug.parallel")

Example

Start up 8 jug instances in parallel:

library(jug)

jug() %>%
  get("/", function(req, res, err){
    "Hello World!"
  }) %>%
  simple_error_handler_json() %>%
  serve_it_parallel(processes=8)
curl 127.0.0.1:8080
Hello World!

One can also call serve_it_parallel with wait=FALSE. This way the terminal will not be blocked and the jug instances will be served in the background. Remember that you will have to clean up the servers manually.

Stop and clean-up all servers:

kill_servers()
[1] TRUE
Stopping servers...success

Benchmarks

Below (non-exhaustive) load tests have been done using loadtest on a MacBook Pro with a 2,5 GHz Intel Core i7 CPU. The requests per second (rps) parameter was set to 1000.

type concurrency requests duration (secs) errors
jug 6 1e2 0.48 0
jug.parallel 6 1e2 0.62 0
jug 6 1e3 1.95 1
jug.parallel 6 1e3 1.37 0
jug 6 1e4 15.08 458
jug.parallel 6 1e4 12.30 0

The most important take away here is that jug.parallel only becomes interesting in cases where you are expecting a (very) high load or where the request processing duration is significant.