Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: shareable transactions #186

Merged
merged 66 commits into from
Nov 15, 2022
Merged

feature: shareable transactions #186

merged 66 commits into from
Nov 15, 2022

Conversation

snork-alt
Copy link
Contributor

No description provided.

snork-alt and others added 30 commits November 8, 2022 01:30
* fix: wait until all schema initialized

* fix: schema length and record length does not match

* chore: add warning when notifier have issue
* fix: terminate stream only when Error is Closed

* chore: use "data" instead schema name in grpc list

* chore: draft version multi endpoint support

* feat: introduce common grpc

* feat: implement onEvent

* fix: clippy + fmt

* feat: implement get_endpoints

* chore: fix testcase

* chore: remove unused code

Co-authored-by: duonganhthu <duonganhthu43@gmail.com>
* chore: fix channel & safe generation

* chore: include fields

* chore: send operation_events instead of records

* chore: include primary_index in fields response
* chore: Bulid sorted inverted key only from field values.

Now that we've opened a new database for every index, we no longer
need to include schema id and field indexes in the secondary index key.

* chore: Build full text key only from tokens
* chore: Derive `Copy` on `FieldType`

* chore: Parse `Value` to `Field` in `QueryPlanner`

* chore: Remove `IndexDefinition` from `IndexScan`

* chore: Remove `Option` from `get_secondary_index`

* chore: Use `OrderedFloat` instead of `f64` in `Field`

* feat: Support `desc` in QueryPlanner

* fix: Test schemas should use different id

* feat: Support descending fields in sorted inverted index

* chore: Use ordered-float 2.10.0 because it's already in our project
@snork-alt snork-alt marked this pull request as ready for review November 15, 2022 16:11
@snork-alt snork-alt requested a review from v3g42 November 15, 2022 16:11
@v3g42 v3g42 merged commit 5c17e0f into main Nov 15, 2022
@v3g42 v3g42 deleted the feature/shareable_tx branch November 15, 2022 16:17
@v3g42 v3g42 modified the milestone: Alpha Release Nov 16, 2022
@v3g42 v3g42 mentioned this pull request Nov 16, 2022
karolisg pushed a commit that referenced this pull request Nov 16, 2022
* feature: implement checkpointing

* fix: wait until all schema initialized before start grpc server (#187)

* fix: wait until all schema initialized

* fix: schema length and record length does not match

* chore: add warning when notifier have issue

* refactor: implement lmdb abstraction

* refactor: use storage abstraction in executor

* Add float sum Aggregator (#189)

* chore: moved schema handling functions in utils file

* feature: implement shared transaction

* chore: moved functions to util

* feature: shared tx on ports

* chore: switch to stable (#188)

* chore: Remove duplicate `get_key` method (#195)

* chore: cleanup port recordstore code

* chore: Remove an unnecessary unwrap (#196)

* feat: introduce generic GRPC queries (#194)

* fix: terminate stream only when Error is Closed

* chore: use "data" instead schema name in grpc list

* chore: draft version multi endpoint support

* feat: introduce common grpc

* feat: implement onEvent

* fix: clippy + fmt

* feat: implement get_endpoints

* chore: fix testcase

* chore: remove unused code

Co-authored-by: duonganhthu <duonganhthu43@gmail.com>

* feature: store per port operations

* chore: add countdown latch for pipeline startup

* rwlock issue

* fixed locking issue

* add Transaction wrappers

* refactor: remove tx passing in forwarder

* chore: fix commit seq_no

* chore: fix channel & safe generation (#198)

* chore: fix channel & safe generation

* chore: include fields

* chore: send operation_events instead of records

* chore: include primary_index in fields response

* chore: split executor in multiple files

* chore: Bulid secondary index key only from values. (#197)

* chore: Bulid sorted inverted key only from field values.

Now that we've opened a new database for every index, we no longer
need to include schema id and field indexes in the secondary index key.

* chore: Build full text key only from tokens

* fix: Secondary index key should never be empty (#200)

* refactor: add stateful/stateless interfaces and executor code layout reorg

* feat: support for optional port databases

* feature: support for stateless processors

* chore: use ipv4 address as default for grpc (#203)

* feat: Support descending fields in sorted inverted index (#202)

* chore: Derive `Copy` on `FieldType`

* chore: Parse `Value` to `Field` in `QueryPlanner`

* chore: Remove `IndexDefinition` from `IndexScan`

* chore: Remove `Option` from `get_secondary_index`

* chore: Use `OrderedFloat` instead of `f64` in `Field`

* feat: Support `desc` in QueryPlanner

* fix: Test schemas should use different id

* feat: Support descending fields in sorted inverted index

* chore: Use ordered-float 2.10.0 because it's already in our project

* chore: update nightly benches script (#201)

* chore: test nightly workflow

* chore: fix nightly

* chore: remove coverage for now

* feat: init benches workflow

* chore: use mutiple restore keys

* chore: include coverage

* chore: upload coverage data to coveralls

* chore: get coverage response

* chore: include coveralls api result

* chore: ignore target folder

* chore: include coverage badge

* fix: make dynamic server optional

* feat: Implement release process (#204)

* feat: Implement deployment process

* chore: release v0.1.0

* fix: redirect events to the right endpoint (#206)

* chore: re-export get_connector (#208)

* chore: added ops manager

* fix: local tests

* feature: implement checkpointing

* refactor: implement lmdb abstraction

* refactor: use storage abstraction in executor

* chore: moved schema handling functions in utils file

* feature: implement shared transaction

* chore: moved functions to util

* feature: shared tx on ports

* chore: cleanup port recordstore code

* feature: store per port operations

* chore: add countdown latch for pipeline startup

* rwlock issue

* fixed locking issue

* add Transaction wrappers

* refactor: remove tx passing in forwarder

* chore: fix commit seq_no

* chore: split executor in multiple files

* refactor: add stateful/stateless interfaces and executor code layout reorg

* feat: support for optional port databases

* feature: support for stateless processors

* chore: added ops manager

* fix: local tests

* rebased

* fix: sql tests

* fix: orchestrator tests

* fix: clippy fixes

* fix: clippy

* fix: clippy

* fix: clippy

Co-authored-by: duonganhthu43 <duonganhthu43@gmail.com>
Co-authored-by: Dario Pizzamiglio <1150680+mediuminvader@users.noreply.github.com>
Co-authored-by: VG <vivekg342@gmail.com>
Co-authored-by: Bei Chu <914745487@qq.com>
@mediuminvader mediuminvader added this to the 0.1.2 milestone Nov 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants