Use prepared statements and concurrent Cassandra reads (lean graph) #503
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Feat : Fix error swallowing
MLH-1762 Fix UnsupportedOperationException with AbstractList
Earlier it was only at request level
PLTS-393 | Fix missing attributes in entity during authz while setting tags
* Remove OD soft affinity * Affinity changes
…stores (#5660) * MLH-1477 add dlq replay service and api endpoint to monitor status (#5566) * MLH-1477 dummy commit * MLH-1477 add branch to build * MLH-1477 update to trigger a build * MLH-1477 dummy commit * MLH-1477 add dlq replay service and api endpoint to monitor status * MLH-1477 dummy commit * MLH-1477 wire in only elastic configuration * MLH-1477 lazily connect to elasticsearch index * MLH-1477 load indexProvider like janusgraph * MLH-1477 initialise bootstrap servers * MLH-1477 increase timeout * MLH-1477 add more logs for debugging. update serializer * MLH-1477 reduce poll time * MLH-1477 use pause and resume * MLH-1477 improve DLQ handling * MLH-1477 break on errors * MLH-1477 seek back when error * MLH-1477 retry with exponential backoff * MLH-1477 add tests * MLH-1477 optimise imports * MLH-1477 remove comment on latest * MLH-1477 remove option to start the dlq manually * MLH-1477 change to non daemon thread and improve destroy and cleanup * MLH-1477 add dependency (#5619) * MLH-1477 add dependency * MLH-1477 add dependency as test * MLH-1477 refactor dlq to use repair flow to keep it idempotent (#5659) * MLH-1477 refactor dlq to use repair flow to keep it idempotent * MLH-1477 handle NPE in mutations map * MLH-1477 set kafka property in atlas startup for DLQ * MLH-1477 not use management system * MLH-1477 remove unused method. also increase poll timeout seconds * MLH-1477 remove cleanUpTransaction since it is not required * MLH-1477 remove cleanUpTransaction since it is not required * MLH-1477 handle NPQ in reindex method
* Whitelist elasticsearch URL for remote re-index * sync with beta and staging
MLH-1521 : Make HasLineage calculation async by pushing it to Kafka
…5698) * MLH-1806 skip dsl optimisation when enableFullRestriction is applied * MLH-1806 add tests * MLH-1806 remove extra lines
MLH-1480 Support Flow<>Flow relationships on Connection Bootstrap policies
MS-456 Fixed tag sync ES issues
* MLH-1799 add startup timing to all Services * MLH-1799 remove unused imports * MLH-1799 add start up metrics for typedef store, graph and task registry * MLH-1799 add start up metrics for policy download, roles and users. create mark down file with metrics name for grafana dashboard * MLH-1799 stop carefully always * MLH-1799 add metrics for roles , policy and users only once Co-authored-by: sriram-atlan <sriram.aravamuthan@atlan.com>
log: add type not found stack trace in log
…-typedef MS-445 handle primitive default value handling based on typedef defin…
GOVFOUN-40 | Revamp Asset-Term Linking
MS-445 fix DLQ Replay tests
Update README.md
Alcon v2 418
Add detailed error logging to help identify corrupt entities/vertices when typeName is null during entity processing. This helps troubleshoot graph corruption issues by logging vertex IDs, GUIDs, and stack traces. Changes: - AtlasTypeRegistry.getType(): Log error with stack trace when typeName is null - EntityGraphMapper: Add null checks with vertex context in mapObjectIdValueUsingRelationship and getInstanceType methods - EntityGraphRetriever: Add null checks with vertex/edge context in mapAttributes methods for struct and relationship processing - .gitignore: Add **/bin pattern Log patterns to search: - ATLAS_TYPE_REGISTRY_NULL_TYPENAME - ATLAS_CORRUPT_VERTEX_NULL_TYPENAME - ATLAS_CORRUPT_STRUCT_NULL_TYPENAME - ATLAS_CORRUPT_RELATIONSHIP_NULL_TYPENAME - ATLAS_INVALID_OBJECT_ID Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
MS-356: Add debug logging for null typeName errors in entity processing
(cherry picked from commit e67ace9)
(cherry picked from commit 612d2d6)
(cherry picked from commit 0586cab)
(cherry picked from commit fb24a3a)
(cherry picked from commit 172990d)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uses cassandra prepared statements and updates the concurrency model for queries.
This also moves to uuid id generation to reduce complexity.