Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

theses #31

Open
snuyanzin opened this issue Jul 18, 2018 · 1 comment
Open

theses #31

snuyanzin opened this issue Jul 18, 2018 · 1 comment

Comments

@snuyanzin
Copy link
Collaborator

snuyanzin commented Jul 18, 2018

  1. DataSource could be used both as source and sink
  2. MetaData should be in code (version control)
  3. DataBlock should be immutable
  4. DataBlock could be idenfined by DataBlockURL (and version ?)
  5. Dimension is a type of limitation which could be used for partitioning (may be refrase?)
  6. Invariant is a type of filtration before final results
  7. DataBlockURL contains information
    • jdbc string in case of jdbc
    • file path in case of file system
    • query to perform on DataSource
    • ???
  8. DataBlock could be reused if there is one more query for data with overlapping datetime intervals e.g. in case of success search by DatablockURL
  9. If no DataBlock found in local cache then it should be built and put in the cache after successful build
  10. In case of concurrent demands to the same DataBlock which is not currently available in local cache the only one request (thread, process, whatever) should build the Datablock while others should wait
  11. Set of rules to convert various types between DataSource's presentations, rules to convert various types of logical relational expressions to corresponding relational expresseions of datasource's convention.
  12. Query might finished with success only if they ask for data in the past
    If there is a query for datetime range in future then it should be failed or scheduled for the time when it comes

possible improvements:

@snuyanzin
Copy link
Collaborator Author

ariadne

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant