Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

0.7.0 Development Merge #238

Merged
merged 263 commits into from
Sep 16, 2021
Merged

0.7.0 Development Merge #238

merged 263 commits into from
Sep 16, 2021

Conversation

kellrott
Copy link
Member

Development branch targeting release 0.7.0. Is planned to include a number of API altering changes.
Improvements include:

  • Updated Protobuf schema (breaks aggregation queries for pre 0.7.0 python clients)
  • Updated python client that removes attribute dict
  • Update the GRIPPER protobuf description to clean up name spacing
  • Support for multiple backend configurations
  • Updated bulk Mongo loader

Because of the API breaking changes, this updates need to occur at the same time as:

  • Updating bmeg.io server
  • Pushing 0.7.0 python client to PyPI
  • Adding pip upgrade instructions to bmeg.io documentation

@kellrott
Stop collecting nil values in aggregation
4c3e98b
@kellrott
Removing excessive debug logging
5f86f50
@kellrott
Upgrading proto and grpc code generation and library versions
ed84405
@kellrott
Fixes to get conformance working
61d6ba1
@kellrott
Changing aggregation to emit results in a stream rather then in a single
9772df8 
block.
@kellrott
Testing github actions for running unit and conformance testing
1b4abae
@kellrott
Adding conformance python dependency installation
4a7a44c
@kellrott
Changing path
100f1fd
@kellrott
Fixing issue with aggregation channel setup
795fd19
@kellrott
Trying to add a parallel mongo test
ceb2d68
@kellrott
Testing git actions
02387b9
@kellrott
Testing github actions
36f56ff
@kellrott
Trying different formatting to see if that gets things to work
a7a35a5
@kellrott
More tests to try and get things working again
45c6139
@kellrott
Trying to pass built binary between tests
f6f87a1
@kellrott
Fixing github action build
6f45d57
@kellrott
Trying to re-add mongo tests
e358a9b
@kellrott
Adding gripper to unit tests
1090dd6
@kellrott
Adding python dependency
08b21c5
@kellrott
Moving disk based aggregation processor before merging in the mem bas…
c26bb7d 
…ed one
@kellrott
Merge remote-tracking branch 'origin/in-mem-aggregation' into protobu…
c2142f9 
…f-update
@kellrott
Fixing unit test
1da0069
@kellrott
Adding more test workflows
47242c2
@kellrott
Updating unit test runner
03db04f
@kellrott
Adding sleep to get servers up before testing
862f7f4
@kellrott
Adding mongo core test to github actions
30b8a7c
@kellrott
Removing protoutil code that replicated functions now built into main…
a2686d2 
… protobuf library
@kellrott
Fixing issues in mongo processor
4152da7
@kellrott
Moving graph file parsing code to use new protobuf library
b5a4e54
@kellrott
Fixing mongo data marshaling
daa5216
@kellrott
Adding listDrivers and listPlugins to client connection class
54213ba
@kellrott
Adding linkMap field to collection description
73fb80e
@kellrott
Adding field link mapping to gripper plugins
8be756e
@kellrott
Starting to simplify the design of the gripper configuration.
75b1ab3 
The edges from the graph driver will only be able to be derived from
edge tables, removing the ability to use 'fieldToField' and 'fieldToId'
configurations. Those methods were never used in practic, created
extensive complications in the code and configuration files, and
any case where that kind of linkage would be needed, it was easier
just to put the logic in the plug in and have it create an edge table.
@kellrott
Updating config
90b5fa9
@kellrott
Fixing integration test for simpler driver design
8dcc866
@kellrott
Removing jsonpath based field access.
410040f
@kellrott
Updating gripper plugin framework to not use '$.' jsonpath prefixes
7e34837
@kellrott
Merge pull request #261 from bmeg/gripper-simplify
008ae86 
Gripper Simplify
@kellrott
Removing unneeded code
da4aaa4
@kellrott
Fixing bug
8d4305b
@kellrott
Merge pull request #260 from bmeg/plugins
d8ea0d7 
Plugins
@kellrott
Updating mongo linkage
5b99342
@kellrott
Fixing index initialization for new mongo driver
65cc358
@kellrott
Fixing gripper path plugin path issue
88f28e0
@kellrott
Adding ability to push mapping via client command line
991d9f5
@kellrott
Adding missing source file
cf8f9d0
@kellrott
Adding pebble backed KV graph driver
987200b
@kellrott
Adding missing config file for tests
c848ee0
@kellrott
Make tidy
50f2360
@kellrott
Mapping pebble bulk write to batch
2a74c5b
@kellrott
Flushing the pubble batch writer when it gets too big
35f5076
@kellrott
Cleaning go.mod
94d69d9
@kellrott
Merge branch 'develop-0.7.0' into pebble-driver
31cceb0
@kellrott
Merge pull request #265 from bmeg/pebble-driver
4cf4d30 
Adding pebble backed KV graph driver
@kellrott
Merge pull request #262 from bmeg/load-mapping
a5411a2 
Adding ability to push mapping via client command line
@kellrott
Updating makefile
d0d145a
@kellrott kellrott merged commit a068bb9 into master Sep 16, 2021
@kellrott kellrott changed the title 0.7.0 Development Merge [WIP] 0.7.0 Development Merge Sep 16, 2021
@kellrott kellrott deleted the develop-0.7.0 branch August 29, 2022 17:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bwalsh bwalsh bwalsh approved these changes

@jordan2lee jordan2lee Awaiting requested review from jordan2lee

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@kellrott @bwalsh @jordan2lee