Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gh-2632 federated store remove graph and delete accumulo table #2785

Conversation

GCHQDev404
Copy link
Contributor

@GCHQDev404 GCHQDev404 commented Oct 23, 2022

This handler will require MANUAL testing against an Accumulo instance.
Remember to add the Handler to the FederatedStore config.

Related Issue

GCHQDev404 and others added 30 commits February 5, 2021 07:26
…federatedstore-federated-operation-remove-midput

# Conflicts:
#	store-implementation/federated-store/src/main/java/uk/gov/gchq/gaffer/federatedstore/operation/FederatedOperation.java
@codecov-commenter
Copy link

codecov-commenter commented Oct 23, 2022

Codecov Report

❗ No coverage uploaded for pull request base (v2-alpha@20413bf). Click here to learn what that means.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             v2-alpha    #2785   +/-   ##
===========================================
  Coverage            ?   65.48%           
  Complexity          ?     2187           
===========================================
  Files               ?      546           
  Lines               ?    17331           
  Branches            ?     2114           
===========================================
  Hits                ?    11350           
  Misses              ?     5018           
  Partials            ?      963           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@GCHQDev404
Copy link
Contributor Author

blocked waiting on #2769

@GCHQDev404 GCHQDev404 changed the title Gh 2632 federated store remove graph and delete accumulo table gh-2632 federated store remove graph and delete accumulo table Oct 23, 2022
…ha' into gh-2630-example-real-federatedstore

# Conflicts:
#	core/access/pom.xml
#	core/cache/pom.xml
#	core/common-util/pom.xml
#	core/data/pom.xml
#	core/exception/pom.xml
#	core/graph/pom.xml
#	core/operation/README.md
#	core/operation/pom.xml
#	core/pom.xml
#	core/serialisation/pom.xml
#	core/store/pom.xml
#	core/store/src/main/java/uk/gov/gchq/gaffer/store/Store.java
#	core/store/src/main/java/uk/gov/gchq/gaffer/store/operation/handler/HasTraitHandler.java
#	core/store/src/test/java/uk/gov/gchq/gaffer/store/StoreTest.java
#	core/store/src/test/java/uk/gov/gchq/gaffer/store/operation/handler/HasTraitHandlerTest.java
#	core/type/pom.xml
#	example/basic/basic-model/pom.xml
#	example/basic/basic-rest/pom.xml
#	example/basic/pom.xml
#	example/federated-demo/pom.xml
#	example/pom.xml
#	example/road-traffic/pom.xml
#	example/road-traffic/road-traffic-demo/pom.xml
#	example/road-traffic/road-traffic-generators/pom.xml
#	example/road-traffic/road-traffic-model/pom.xml
#	example/road-traffic/road-traffic-rest/pom.xml
#	integration-test/pom.xml
#	library/bitmap-library/pom.xml
#	library/cache-library/hazelcast-cache-service/pom.xml
#	library/cache-library/hazelcast-cache-service/src/test/resources/hazelcast.xml
#	library/cache-library/jcs-cache-service/pom.xml
#	library/cache-library/pom.xml
#	library/flink-library/pom.xml
#	library/hdfs-library/pom.xml
#	library/pom.xml
#	library/sketches-library/pom.xml
#	library/spark/pom.xml
#	library/spark/spark-accumulo-library/pom.xml
#	library/spark/spark-library/pom.xml
#	library/time-library/pom.xml
#	pom.xml
#	rest-api/accumulo-rest/pom.xml
#	rest-api/common-rest/pom.xml
#	rest-api/common-rest/src/main/java/uk/gov/gchq/gaffer/rest/SystemProperty.java
#	rest-api/common-rest/src/main/resources/version.properties
#	rest-api/core-rest/pom.xml
#	rest-api/hbase-rest/pom.xml
#	rest-api/map-rest/pom.xml
#	rest-api/parquet-rest/pom.xml
#	rest-api/pom.xml
#	rest-api/spring-rest/pom.xml
#	store-implementation/accumulo-store/pom.xml
#	store-implementation/accumulo-store/src/main/java/uk/gov/gchq/gaffer/accumulostore/retriever/AccumuloSetRetriever.java
#	store-implementation/accumulo-store/src/test/java/uk/gov/gchq/gaffer/accumulostore/operation/handler/GetElementsWithinSetHandlerTest.java
#	store-implementation/accumulo-store/src/test/java/uk/gov/gchq/gaffer/accumulostore/retriever/impl/AccumuloIDWithinSetRetrieverTest.java
#	store-implementation/federated-store/pom.xml
#	store-implementation/federated-store/src/test/java/uk/gov/gchq/gaffer/federatedstore/FederatedGraphStorageTraitsTest.java
#	store-implementation/federated-store/src/test/java/uk/gov/gchq/gaffer/federatedstore/FederatedStoreGetTraitsTest.java
#	store-implementation/hbase-store/README.md
#	store-implementation/hbase-store/pom.xml
#	store-implementation/hbase-store/src/main/java/uk/gov/gchq/gaffer/hbasestore/HBaseStore.java
#	store-implementation/map-store/pom.xml
#	store-implementation/parquet-store/README.md
#	store-implementation/parquet-store/pom.xml
#	store-implementation/parquet-store/src/main/java/uk/gov/gchq/gaffer/parquetstore/ParquetStore.java
#	store-implementation/pom.xml
#	store-implementation/proxy-store/pom.xml
…atedstore-delete-accumulo-table

# Conflicts:
#	example/federated-demo/src/main/resources/operationDeclarations.json
#	store-implementation/federated-store/src/main/java/uk/gov/gchq/gaffer/federatedstore/FederatedGraphStorage.java
#	store-implementation/federated-store/src/main/java/uk/gov/gchq/gaffer/federatedstore/util/FederatedStoreUtil.java
…e' into gh-2632-federatedstore-delete-accumulo-table

# Conflicts:
#	store-implementation/federated-store/src/main/java/uk/gov/gchq/gaffer/federatedstore/operation/handler/impl/FederatedRemoveGraphDeleteAccumuloTableHandler.java
@GCHQDev404 GCHQDev404 force-pushed the gh-2632-FederatedStore-RemoveGraphAndDeleteAccumuloTable branch from 617f2f7 to 8e1fc24 Compare October 23, 2022 19:52
@GCHQDev404
Copy link
Contributor Author

blocked waiting on #2631

@GCHQDev404 GCHQDev404 added the blocked Requires other issue(s) to be resolved label Oct 23, 2022
GCHQDeveloper314 and others added 3 commits October 24, 2022 09:06
…eal-federatedstore

# Conflicts:
#	store-implementation/federated-store/src/test/java/uk/gov/gchq/gaffer/federatedstore/FederatedStoreCacheBackwardCompatibilityTest.java
#	store-implementation/federated-store/src/test/java/uk/gov/gchq/gaffer/federatedstore/FederatedStoreTest.java
@GCHQDev404 GCHQDev404 closed this Oct 24, 2022
@GCHQDev404 GCHQDev404 deleted the gh-2632-FederatedStore-RemoveGraphAndDeleteAccumuloTable branch October 24, 2022 13:24
@GCHQDev404 GCHQDev404 restored the gh-2632-FederatedStore-RemoveGraphAndDeleteAccumuloTable branch October 24, 2022 13:27
@GCHQDev404 GCHQDev404 reopened this Oct 24, 2022
…atedStore-RemoveGraphAndDeleteAccumuloTable
…store-hotfix

# Conflicts:
#	store-implementation/federated-store/src/main/java/uk/gov/gchq/gaffer/federatedstore/operation/handler/impl/FederatedOperationHandler.java
#	store-implementation/federated-store/src/test/java/uk/gov/gchq/gaffer/federatedstore/FederatedStoreCacheBackwardCompatibilityTest.java
#	store-implementation/federated-store/src/test/java/uk/gov/gchq/gaffer/federatedstore/operation/handler/FederatedOperationHandlerTest.java
…ha' into gh-2632-FederatedStore-RemoveGraphAndDeleteAccumuloTable
@GCHQDev404 GCHQDev404 removed the blocked Requires other issue(s) to be resolved label Oct 25, 2022
* @see FederatedStore
* @see RemoveGraph
*/
public class FederatedRemoveGraphDeleteAccumuloTableHandler extends FederatedRemoveGraphHandler {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could this be done as a DeleteGraph operation that is implemented by MapStore and AccumuloStore, and the FederatedStore can pass that to the relevant store? As part of remove graph?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A Mapstore just stops existing.
AccumuloStore possibly it deletes the table, but the Accumlo instance continues to live.
This is possibly useful.

Federation would need to send DeleteGraph operation to all stores. Only AccumuloStore would support the operation.

Federation would still require a second Handler. I think.

*additional comment taken offline

…Store-RemoveGraphAndDeleteAccumuloTable

# Conflicts:
#	example/federated-demo/src/main/resources/federatedStore.properties
#	example/federated-demo/src/main/resources/operationDeclarations.json
#	example/real-federated-store/README.md
#	example/real-federated-store/have-a-go-at-operations/README.md
#	example/real-federated-store/have-a-go-at-operations/curl-operation-examples/curl_getAllElements.sh
#	example/real-federated-store/have-a-go-at-operations/curl-operation-examples/curl_getAllGraphIds.sh
#	example/real-federated-store/have-a-go-at-operations/curl-operation-examples/curl_getSchema.sh
#	example/real-federated-store/have-a-go-at-operations/curl-operation-examples/curl_getSchema_alternative.sh
@GCHQDev404 GCHQDev404 force-pushed the gh-2632-FederatedStore-RemoveGraphAndDeleteAccumuloTable branch from 9c4d5b8 to fef4393 Compare October 25, 2022 22:13
@GCHQDev404
Copy link
Contributor Author

Approach requires a re-work see ticket.

@GCHQDev404 GCHQDev404 closed this Oct 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants