Customized Children endpoints

• removes chunk minimum chunk size validation to allow smaller than optimal chunks, such as for the last upload.
• refactors GraphDB code into background job
• adds grape_logging gem for more logging goodness
• workflow.stress.sh script for stress testing the system
• stop chunks from updating upload.etag on save, which was causing a race condition and db deadlocking

Chunk Upload Management

Uploads have a maximum size, and a maximum number of possible chunks
POST /uploads returns a suggested minimum chunk size
PUT /uploads/:id/chunks will return an error if the operation results in too many chunks

Background Jobs

Swift Storage manipulation, ChildDeletions, and Elasticsearch indexing are now managed by background jobs. Objects with dependencies on these external systems (Projects, Uploads, Files, Folders) are tracked with an eventual consistency framework.

Eventual Consistency Documentation

LDAP bugfixes

This release fixes problems in the ldap search system to allow searches for affiliates without uncaught errors relating to result truncation and missing attributes such as email.

Auth Provider Affiliates

This is the release of the Auth Provider Affiliates endpoints.

Additional changes includes:

• Removal of the DDS-portal
• Elasticsearch bug fixes
• Redirecting root to apidocs

Elasticsearch bulk reindex retry logic

Merge pull request #932 from dmlond/DDS-811_batch_retries-prod

[Production] DDS-811 batch retries

v1.1.3

uses elasticsearch batch indexing of folders and files

v1.1.2

This release includes:

• Project Transfer
• OIT’s OAuth
• Multiple Authentication Providers
• Pagination for children and projects

MVP++

This is the MVP release of the Duke Data Service, with extensions for graphdb, and elasticsearch