Skip to content

In Spark SQL, It should be possible to use several MongoDB instances (and configurations) in a single context #15

@spirom

Description

@spirom

While CREATE TEMPORARY TABLE can be used to register multiple MongoDB collections in multiple MongoDB databases, they must all be at the same MongoDB endpoint (host/port) and all other configuration must be the same. This is because all such configuration is attached to the SparkContext.

It should be possible ro provide ALL of this configuration information as part of the OPTIONS clause of CREATE TEMPORARY TABLE (whereas currently this is only possible with the database and collection names.).

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions