Connector for DynamoDB

[vscharfkatz]

DynamoDB is a widely use NoSQL environment where data is stored. We suggest to build a connector allowing to connect Plotly to DynamoDB

[n-riesco]

We are already using https://www.npmjs.com/package/aws-sdk to implement the S3 connector, and aws-sdk supports DynamoDB. So this is definitely doable.

I'm going to label this one as community and good first issue.

Some useful links:

• http://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/dynamodb-example-query-scan.html
• https://aws.amazon.com/blogs/aws/dynamodb-local-for-desktop-development/

[n-riesco]

From slack:

@shannonlal When you have 2 minutes can you have a look at this DynamoDB library (https://www.npmjs.com/package/@awspilot/dynamodb-sql). Seems like a DynamoDB SQL library. If I could just use this library I could probably throw together something for DynamoDB.

I had a quick look at dynamodb-sql. It looks OK. I've only noticed 2 difficulties:

1. the implementation of SHOW TABLES doesn't account for databases with 100+ tables (we'd have to contribute a PR; see https://github.com/awspilot/dynamodb-sql/blob/b6270798f74e480721b0a06d169006017e591c85/lib/dynamodb.js#L31-L38)

2. to implements schemas(), we'd have to make multiple queries: first to request the list of tables (listTables), and then, for each table, a query to describe the table ('describeTable').

[n-riesco]

https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_ListTables.html
https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_DescribeTable.html

[n-riesco]

:( Maybe, I'm misreading this, but it looks like dynamo-sql doesn't account for queries that return large responses and require pagination.