Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow definition of Views in Datastore which are exposed as Computed Datasets #60

Closed
jqnatividad opened this issue May 28, 2014 · 6 comments

Comments

@jqnatividad
Copy link
Contributor

Views are nothing more than stored queries.

Oftentimes, when uploading open data, publishers denormalize data in their transaction DBs into big, wide tables. Having views against these tables would make it easier for data consumers to digest the data.

It will also help with complex queries/joins across tables. And perhaps, for certain popular, expensive queries, materialized views can be used to increase performance.

@jqnatividad
Copy link
Contributor Author

This can be done in coordination with #59, as some system catalog objects can just be views, similar to the way Oracle's system catalog is composed primarily of views.

If views are supported, maybe there can even be a way for CKAN extensions to register views (e.g. stats can add view/download metrics to the catalog; a geocoder extension can extend a dataset's metadata with geographical info, etc.)

@rufuspollock
Copy link
Member

@jqnatividad have you seen #28 (custom data APIs) - do you think there is a connection here? Would this possibly be a subpart of #28?

@jqnatividad
Copy link
Contributor Author

@rgrp I haven't seen #28 (custom data APIs) before I posted this, but yes, there is definitely a connection!

Perhaps, we can start showing the power of this approach with the System Metadata Catalog #59?

@rufuspollock
Copy link
Member

@jqnatividad I'm suggesting to merge this with #28 - wdyt?

@jqnatividad
Copy link
Contributor Author

@rgrp makes sense to me - merge away!

@rufuspollock
Copy link
Member

DUPLICATE / MERGED WITH #28.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants