Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Plt 1300 search cancellation from metastore with global context cache using redis #2987

Merged
merged 58 commits into from
May 2, 2024
Merged

Plt 1300 search cancellation from metastore with global context cache using redis #2987

merged 58 commits into from
May 2, 2024

Conversation

sumandas0
Copy link

Change description

Description here

Type of change

  • Bug fix (fixes an issue)
  • New feature (adds functionality)

Related issues

Fix #1

Checklists

Development

  • Lint rules pass locally
  • Application changes have been tested thoroughly
  • Automated tests covering modified code pass

Security

  • Security impact of change has been considered
  • Code follows company security practices and guidelines

Code review

  • Pull request has a descriptive title and context useful to a reviewer. Screenshots or screencasts are attached as necessary
  • "Ready for review" label attached and reviewers assigned
  • Changes have been reviewed by at least one other contributor
  • Pull request linked to task tracker where applicable

bichitra95 and others added 30 commits March 28, 2024 10:02
@bichitra95
Add DataContract preprocessor and versioning
27285ad
@bichitra95
Refactore contract code and release
5c53ca1
@bichitra95
Add unknown attributes to DataContract and fix minor bugs
94d98db
@bichitra95
Add attribute hasContract for assets
d64e969
@bichitra95
Add validation of data contract spec
6ee00aa
@bichitra95
Fix audit logs for associated asset
c79dfa0
@bichitra95
Update dataset spec structure
723286a
@bichitra95
Minor bug fix
3e6f1b2
@bichitra95
Refactor with new attributes
f69d6f6
@bichitra95
Fix order of attributes in contract and change dataContractVersion to…
3e75d0f 
… integer
@bichitra95
Add bootstrap policy for DataContract CRU
2e30f63
@bichitra95
Fix qualifiedName of the contract
32104e9
@bichitra95
Add asset guid in DataContract asset and minor fixes
8185bfe
@bichitra95
Inconsistency in relationship fixed for data contract<>asset
e863c13
@bichitra95
Removed maven release for data-contract branch
2971520
@rmovaliya
fix: lineage api node limit exceeding
8a16887
@suraj5077
Merge pull request #2947 from atlanhq/bugfix/lineage-api-node-limit-e…
0e89204 
…xceeding

fix: LIN-824: lineage api node limit exceeds max allowed node
@sumandas0
feat: implement redis as our cache provider
b63c316
@sumandas0
fix: just tap the utm tags coming from product
203b45f
@sumandas0
fix: make change to add sourse as tag
b7e3f15
@sumandas0
Merge pull request #2952 from atlanhq/fix-utm-tags
ff7cdd5 
fix: just tap the utm tags metrics coming from product for indexsearch metric
@sumandas0
Merge branch 'master' into PLT-1300-search-cancellation-from-metastor…
751ac67 
…e-with-global-context-cache-using-redis
@sumandas0
fix: remove local change
f7e9f35
@bichitra95
Change datasource to data_source in DataContract
4cd524d
@bichitra95
Merge create and update AuthPolicy for DataContract
8ed00b3
@bichitra95
Update DataContract attributes from public to private and create gett…
5434342 
…er for needed attributes
@bichitra95
Add setter for private attributes and formatted the file
09c500a
@bichitra95
Address PR review changes
d78cdc1 
* Remove version util and moved getCurrentVersion method to preprocessor
* Remove unused varibles
* Optimize fetching latest version of contract
*
@bichitra95
Address code review comments
9779ffe 
    * Remove purgebyId call and remove skip auth in the purge method
    * Make DataContract attributes public for serialisation and deserialisation of JSON
    * Make minor changes for optimisation
@bichitra95
Remove redundant code/arguments in contract preprocessor
191b447
bichitra95 and others added 28 commits April 30, 2024 12:12
@bichitra95
Add remove user added relationship to control relationship update
9f26e46
@bichitra95
Ignoring null value fields
418a8cf
@bichitra95
Upgrade validator version to avoid vulnerability
fb0ee62
@rmovaliya
add depth in list lineage api
6777a38
@bichitra95
Merge pull request #2937 from atlanhq/data-contract
7a3a1c5 
DQ-22: Data contract PreProcessor
@sumandas0
feat: add perf metrics
c6b4c5d
@sumandas0
feat: add perf for async search check
7738fd9
@sumandas0
Merge pull request #2965 from atlanhq/PLT-1300-search-cancellation-fr…
473fd60 
…om-metastore-with-global-context-cache-using-redis

feat: Search cancellation from Metastore with global context cache using Redis
@rmovaliya
correct the depth for process base node
651792d
@rmovaliya
rename variable
34dc156
@sumandas0
Revert "feat: Search cancellation from Metastore with global context …
a41e3c0 
…cache using Redis"
@sumandas0
Merge pull request #2971 from atlanhq/revert-2965-PLT-1300-search-can…
ef17ed2 
…cellation-from-metastore-with-global-context-cache-using-redis

Revert "feat: Search cancellation from Metastore with global context cache using Redis"
@rmovaliya
resolve conflict
8ca65e2
@sumandas0
feat: run Redis ops async and reduce wait time for search cache
29adef5
@rmovaliya
update minor changes
ea76a4d
@sumandas0
fix: just use new config
2d8cbd9
@sumandas0
fix: update config
1cb04d5
@sumandas0
feat: update conetxt naming in redis client
d38091a
@suraj5077
Merge pull request #2974 from atlanhq/add-depth-in-lineage-list-api
5687784 
[master] LIN-851: Add depth attribute in lineage list api
@sumandas0
fix: set redis timeout as 10 sec
df38645
@sumandas0
Revert "Revert "feat: Search cancellation from Metastore with global …
0f68575 
…context cache using Redis""
@sumandas0
Merge remote-tracking branch 'origin/revert-2971-revert-2965-PLT-1300…
7afeb44 
…-search-cancellation-from-metastore-with-global-context-cache-using-redis' into PLT-1300-search-cancellation-from-metastore-with-global-context-cache-using-redis
@sumandas0
feat: add failure metrics for redis
93c0834
@sumandas0
feat: redis client rename
fce4132
@sumandas0
nit: remove red. excp handling and rename cfg
5232e56
@sumandas0
fix: remove redundant search metric
da3191c
@sumandas0
feat: add local search context cache as backup
686a9e2
@sumandas0
Update pom.xml
5bf86cf
@sumandas0 sumandas0 self-assigned this May 2, 2024
@sumandas0 sumandas0 merged commit 9b19d24 into staging May 2, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@sumandas0 sumandas0

Labels
None yet
Projects
None yet
Milestone
No milestone
4 participants
@sumandas0 @bichitra95 @rmovaliya @suraj5077