Add latency stats items to S3 API and velvet calls  [JIRA: RCS-220]

Reviewed-by: kuenishi

…issing

Add default riak_cs_wm_common's multiple_choices callback  [JIRA: RCS-221]

Reviewed-by: kuenishi

Stack error reasons on block retrieving failure [JIRA: RCS-223]

Reviewed-by: shino

…fline-gc-tool

Filter out meta dir in offline gc tool  [JIRA: RCS-238]

Reviewed-by: kuenishi

2i for listing MP uploads should use equal query but the function
riakc_pb_socket:get_range/5 was used which is for range query.  But,
so luckily, this bug did not manifests for user facing response.

The reason was two-fold,
1. only 2i key is important and value is always <<"1">> for MP 2i, and
2. Timeout value 60000 (integer) is larger than <<"1">> after
   converted to binary.

So this commit fixes a bug that has not became reality ever.

Add latency stats for riak pb client operations

Reviewed-by: kuenishi

Add status around PB pools, memory, system and mochiweb [RCS-244]

Reviewed-by: kuenishi

The bug was introduced at commit a07eb28.
This commit is a partial revert ot it.

True fix

Fix two lines of wrong rtcs:pass() usage in access_stats_test

Reviewed-by: kuenishi

change default value to 50

Velvet have been including many duplicate code. There are still
many duplicates, but so far this will be kept as it is.

So that buildbot can detect a little broader compile error

and don't ignore stderr so that one can notice such warnings/errors

Feature/merge velvet

Reviewed-by: shino

Misc improvements around build

Reviewed-by: kuenishi

Use right timeout config [RCS-237]

Reviewed-by: shino

Fix proxy_get defined in riak-cs.conf not working [JIRA: RCS-236]

Reviewed-by: shino

Update dependencies

Reviewed-by: shino

…fests-in-cuttlefish

Add max_scheduled_delete_manifests config into cuttlefish schema

Reviewed-by: shino

Add stanchion stats test for API and command

Reviewed-by: kuenishi

Fast user get option [JIRA: RCS-240]

Reviewed-by: shino

Non-existent source and illegal access to source is handled
by this commit to respond resource path in XML bocy as source path.

Bugfix/copy object bugs

Reviewed-by: kuenishi

Following style of IP address description in IPAddress Condition have
not been working as parser implicitly assumed single IP address per
'aws:SourceIp' condition.

```
"IpAddress": {
    "aws:SourceIp": ["127.0.0.1/32", "192.168.100.0/24"]
}
```

- Explicitly output "no inconsistecies"
- For tuple output, add period in order to consult the output afterward
  and line break for human friendliness

Add audit tool to extract inconsistencies between users and buckets

Reviewed-by: kuenishi

Fix policy parser to accept multiple IP address per statement  [JIRA: RCS-222]

Reviewed-by: shino

Bump version to 2.1.0

Reviewed-by: shino

And change ceph/s3-tests branch to updated one for Riak CS 2.1 release

Errors by client side mistake or (supposed) race is not for error
severity in server operator sense.  Also, lager's logging with error
level triggers disk sync in default settings, it may load disk.

…sions

Example response:

HTTP/1.1 501 Not Implemented
Server: Riak CS
Date: Fri, 07 Aug 2015 05:18:13 GMT
Content-Type: application/xml
Content-Length: 217

<?xml version="1.0" encoding="UTF-8"?>
<Error>
  <Code>NotImplemented</Code>
  <Message>A request you provided implies functionality that is not implemented</Message>
  <Resource>/test/</Resource>
  <RequestId/>
</Error>

Reference
- PUT Object - Copy - Amazon Simple Storage Service :
  http://docs.aws.amazon.com/AmazonS3/latest/API/RESTO   bjectCOPY.html
- Test cases in ceph/s3-tests
  s3tests.functional.test_s3:test_object_copy_replacing_metadata
  s3tests.functional.test_s3:test_object_copy_retaining_metadata

Before this commit, parts to be deleted is calculated based on keys
of {PartNumber, ETag}. If there is retry of upload, there exist multiple
parts with the same {PartNumber, ETag} pair.
This commit fixes it by using ?PART_MANIFEST.part_id, UUIDv4, to
extract parts to be deleted.

Because unused items has been removed.
cf https://github.com/basho/stanchion/pull/102/files

…-inspector

Add sort option and stream key listing to inspector

Reviewed-by: shino

…kets

Before this commit, detailed storage calc JSON result for empty
buckets looks like:

{
    "bucket-1": {},
    "bucket-2": {},
    "EndTime": "20150814T023756Z",
    "StartTime": "20150814T023756Z"
}

Because non-detialed storage calc adds keys of "Objects" and "Bytes" even for
empty buckets, this commits adds such keys for detailed ones.

Cf. Introduce `riak_kv_multi_prefix_backend` by kuenishi · Pull Request #1082
    basho/riak_kv#1082

…lete-on-rt

Verify realtime sync complete on rt

Reviewed-by: shino

…stly

Update ceph s3 tests for Riak CS 2.1.0 with bug fixes

Reviewed-by: kuenishi

Fixed bugs

- Handling of copy source that starts with multiple slashes
- Handling of copy source that does not include key part
- Respond with 404 when source is not found
- Remove unused branch in catch and remove unsed function