New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In Spark SQL, It should be possible to use several MongoDB instances (and configurations) in a single context #15

Open
spirom opened this Issue May 2, 2015 · 0 comments

Comments

Projects
None yet
1 participant
@spirom
Owner

spirom commented May 2, 2015

While CREATE TEMPORARY TABLE can be used to register multiple MongoDB collections in multiple MongoDB databases, they must all be at the same MongoDB endpoint (host/port) and all other configuration must be the same. This is because all such configuration is attached to the SparkContext.

It should be possible ro provide ALL of this configuration information as part of the OPTIONS clause of CREATE TEMPORARY TABLE (whereas currently this is only possible with the database and collection names.).

@spirom spirom added the enhancement label May 2, 2015

@spirom spirom self-assigned this May 2, 2015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment