Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(PXP-10739): Add bucket region to DRS #355

Draft
wants to merge 19 commits into
base: master
Choose a base branch
from
Draft

Conversation

BinamB
Copy link
Contributor

@BinamB BinamB commented Mar 30, 2023

Jira Ticket: PXP-xxxx

  • Remove this line if you've changed the title to (PXP-xxxx): <title>

New Features

  • Add bucket region information to DRS object

Breaking Changes

Bug Fixes

Improvements

Dependency updates

Deployment changes

@github-actions
Copy link

The style in this PR agrees with black. ✔️

This formatting comment was generated automatically by a script in uc-cdis/wool.

@BinamB BinamB changed the title Feat/pull bucket info (PXP-10739): Add bucket region to DRS Mar 30, 2023
Copy link
Contributor

@Avantol13 Avantol13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This caching strategy isn't super useful when there are many instances of the service running (since all the caches are in-memory and specific to that pod). Since we expect many instances of indexd to be running, I would suggest we look into a more centralized caching solution similar to what's been done in Fence (look for how we dealt with caching creds during signed URL calls or even some of RAS stuff maybe). The idea being: we need a central place for newly spun up instances of indexd to get the cached information. Naive solution (and what we did in Fence) was have a new database table to store the central cache AND in-mem cache in the instances

@k-burt-uch k-burt-uch self-requested a review May 2, 2023 20:29
bucket_region_info = response.json()
cache.set("bucket_region_info", response.json(), timeout=3600)
else:
print(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use the logger for this.

)
break
else:
print(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use the logger.

@@ -1,3 +1,5 @@
import os
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unused import

indexd/app.py Outdated
@@ -3,6 +3,7 @@

from alembic.config import main as alembic_main
import cdislogging
from distutils.command.config import config
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you still need this config here?

@BinamB BinamB marked this pull request as draft June 21, 2023 15:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants