Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In Spark SQL, It should be possible to use several MongoDB instances (and configurations) in a single context #15

Open
spirom opened this issue May 2, 2015 · 0 comments
Assignees
Labels

Comments

@spirom
Copy link
Owner

@spirom spirom commented May 2, 2015

While CREATE TEMPORARY TABLE can be used to register multiple MongoDB collections in multiple MongoDB databases, they must all be at the same MongoDB endpoint (host/port) and all other configuration must be the same. This is because all such configuration is attached to the SparkContext.

It should be possible ro provide ALL of this configuration information as part of the OPTIONS clause of CREATE TEMPORARY TABLE (whereas currently this is only possible with the database and collection names.).

@spirom spirom added the enhancement label May 2, 2015
@spirom spirom self-assigned this May 2, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
1 participant
You can’t perform that action at this time.