Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does superset support integration with MongoDB? #4231

Closed
priyankajuyal opened this issue Jan 18, 2018 · 23 comments
Closed

Does superset support integration with MongoDB? #4231

priyankajuyal opened this issue Jan 18, 2018 · 23 comments
Labels
inactive Inactive for >= 30 days

Comments

@priyankajuyal
Copy link

I tried connecting using the following SQLAlchemy URI
mongodb://localhost:27017/test

and faced the following error:
ERROR: {"error": "Connection failed!\n\nThe error message returned was:\nCan't load plugin: sqlalchemy.dialects:mongodb"}

Is there any workaround? Please suggest.

@xrmx
Copy link
Contributor

xrmx commented Jan 18, 2018

Feel free to contribute a mongodb sqlalchemy dialect.

@xiaohanyu
Copy link
Contributor

@priyankajuyal I think there're 3 methods to support mongodb in superset:

  • Implement a mongodb in sqlalchemy, this requires a lot of work and may not be easy to do cause sqlalchemy is a object relational mapper library, while mongodb is not relational.
  • Implement a new connector for superset. Right now superset has two connectors, one is for sqlalchemy, one is for druid, and similar things can be implemented for mongodb, this should be the right choice.
  • Transform mongodb to some relational db, stripe has a deprecated project for this job: https://github.com/stripe/mosql.

@rumbin
Copy link
Contributor

rumbin commented Jan 18, 2018

4th option:

Use an SQL wrapper like https://dremio.com.

(I am not related to this project or company, but happened to stumble upon it, recently)

@alanderex
Copy link

5th option:

There is a tool called BI Connector from mongodb, this tool can map mongodb schemata to relational. It's used to interact e.g. with Tableau or other BI Tools. Unfortunately AFAIK it's only available in a paid mongodb version. https://www.mongodb.com/products/bi-connector

@tomasienrbc
Copy link

@rumbin I don't think there's a Dremio connector for Superset though, have you seen one?

@ksangeet9ap
Copy link

ksangeet9ap commented Aug 25, 2018

I have created a MongoDB connector for Superset under the name of cosmos. It is still WIP. Feel free to check it out. Star it and post issues so that it can be developed further. https://github.com/ksangeet9ap/incubator-superset

@mistercrunch
Copy link
Member

For Dremio, your best bet is probably https://github.com/sqggles/sqlalchemy_dremio

@ksangeet9ap
Copy link

ksangeet9ap commented Aug 30, 2018

@mistercrunch Any plans on integrating NoSQL databases to Superset?

@mistercrunch
Copy link
Member

The real question is "Any plans for NoSQL databases to start supporting SQL?". ElasticSearch just added experimental SQL support, Druid added SQL a few years back. Apache Calcite makes that a lot easier now.

Even though it's totally doable with Superset (check out the superset/connectors folder, and druid/ as an example of NoSQL support), I haven't heard anyone working on it besides the ElasticSearch effort on an open PR. Now that ElasticSearch offers SQL support we'll probably go the SQLAlchemy route.

@stale
Copy link

stale bot commented Apr 10, 2019

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the inactive Inactive for >= 30 days label Apr 10, 2019
@stale stale bot closed this as completed Apr 17, 2019
@vamshi9666
Copy link

so , how may anyone use superset with MongoDB .
Please, tell me any possible way of doing it

@yuxiaorui
Copy link

yuxiaorui commented Feb 5, 2020

1、Mongodb-BI-Connector with sqlalchemy-mongobi
http://docs.mongodb.com/bi-connector/master/
https://pypi.org/project/sqlalchemy-mongobi/
2、Presto MongoDB Connector
https://prestodb.io/docs/current/connector/mongodb.html

@bnorbert
Copy link

bnorbert commented Feb 11, 2020

1、Mongodb-BI-Connector with sqlalchemy-mongobi
2、Presto MongoDB Connector
@yuxiaorui can you provide an example or more details?

@sanderdekoning
Copy link

1、Mongodb-BI-Connector with sqlalchemy-mongobi
2、Presto MongoDB Connector

Could you explain how I would implement this?

@thunderbird57
Copy link

5th option:

There is a tool called BI Connector from mongodb, this tool can map mongodb schemata to relational. It's used to interact e.g. with Tableau or other BI Tools. Unfortunately AFAIK it's only available in a paid mongodb version. https://www.mongodb.com/products/bi-connector

Its available for free now. I would like to know if someone was able to connect through it

@shrivastava-utkarsh
Copy link

shrivastava-utkarsh commented Sep 13, 2020

1、Mongodb-BI-Connector with sqlalchemy-mongobi
http://docs.mongodb.com/bi-connector/master/
https://pypi.org/project/sqlalchemy-mongobi/
2、Presto MongoDB Connector
https://prestodb.io/docs/current/connector/mongodb.html

I tried using the 1st option. It gives me driver not found error. I installed it in the same venv also. but still no luck. Did anyone got it working this way?
ERROR: Could not load database driver: mongobi
the exact error when testing connection using sql alchemy uri

@MarcusSorealheis
Copy link
Contributor

Is there anybody using Superset and MongoDB?

@jbouzekri
Copy link

I just made a proof of concept of querying a mongo database with superset through mongo bi connector : https://github.com/jbouzekri/docker-superset-mongo-poc/. It seems to work pretty well. It is not in the documentation but I have tested row level security and it works too.

@kodeine
Copy link

kodeine commented Jun 6, 2022

@jbouzekri thank you for the POC! really appreciate your efforts.

@Hugh-Guan
Copy link

@jbouzekri thank you for the POC! But I ran into some problems using it: pulling the code locally and then executing the 'docker-compose up' directive encountered an error and terminated the directive. Could you give me some help?

@jbouzekri
Copy link

@Hugh-Guan : can you open an issue directly in the POC repository with the details of the error ? Thanks in advance

@Hugh-Guan
Copy link

@Hugh-Guan : can you open an issue directly in the POC repository with the details of the error ? Thanks in advance

@jbouzekri Thank you for your reply. I have put forward an issue in the project

@pesua
Copy link

pesua commented Oct 10, 2022

Have anyone tried integrating Superset with Azure Cosmos DB? It has a MongoDB API, I wonder if it works with sqlalchemy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
inactive Inactive for >= 30 days
Projects
None yet
Development

No branches or pull requests