Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DM-39343] Breaking down all tap schema databases #120

Merged
merged 1 commit into from Jun 7, 2023
Merged

Conversation

cbanek
Copy link
Contributor

@cbanek cbanek commented May 31, 2023

No description provided.

tap-schema/build-all Outdated Show resolved Hide resolved
tap-schema/build-all Outdated Show resolved Hide resolved
tap-schema/build-all Outdated Show resolved Hide resolved
tap-schema/build-all Outdated Show resolved Hide resolved
./build tap-schema-usdf-dev-obstap ../yml/dp02_obscore.yaml ../yml/oga_live_obscore.yaml
./build tap-schema-usdf-prod-obstap ../yml/dp02_obscore.yaml

./build tap-schema-idfprod-sso ../yml/dp03.yaml
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The SSOs are fine, but I don't really see a need to have five separate ones, as there is only one back-end DB.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So that they can have different schemas as we test things and move it around, it doesn't hurt us and it follows the pattern

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

which one is the backend DB? i thought we had a bunch?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

which one is the backend DB? i thought we had a bunch?

As far as I know there is currently only one DP0.3 / SSO database - a Postgres DB at SLAC.

It's not wrong to have five identical TAP_SCHEMA builds for this, and I can think of some ways we might use them, conceivably, so I'm not asking you to remove them, but just noting that it's flexibility we might not need.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And how many environments do you want connected to that SSO database? just usdf-dev? usdf-dev and usdf-prod? I want to know not only which databases exist but which tap services exist

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Based on @fritzm's response on #dm-rsp-team this morning, I think the answer is that we want an SSO-only TAP service on all five of idf-prod, idf-int, idf-dev, usdf-prod, and usdf-dev. All of them will normally point to the same SSO-only Postgres database at USDF, except that during the upcoming USDF outage the IDF RSPs' SSO TAP services will point to the replica of that database recently set up by Dan in the Google cloud. (See Slack for more discussion of the timing of the switchover.)

As I said above, I don't foresee any reason for the TAP_SCHEMA content of the five to be different from each other, but if you want to create five images as a hedge, I don't object.

./build tap-schema-usdf-dev-tap ../yml/dp02_dc2.yaml ../yml/dp02_obscore.yaml
./build tap-schema-usdf-prod-tap ../yml/dp02_dc2.yaml ../yml/dp02_obscore.yaml

./build tap-schema-usdf-dev-obstap ../yml/dp02_obscore.yaml ../yml/oga_live_obscore.yaml
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not correct - "live ObsCore" is on a different back-end (Postgres) DB from DP0.2 ObsCore, which is on Qserv.

Let's call this one "tap-schema-usdf-dev-live-obscore", and it has only ../yml/oga_live_obscore.yaml on it.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm trying to name it after the environment + tap service they are using just to be explicit.

@cbanek
Copy link
Contributor Author

cbanek commented Jun 1, 2023

So which tap schemas are tap services that we don't want to run?

@cbanek
Copy link
Contributor Author

cbanek commented Jun 1, 2023

SSO on idf

@cbanek cbanek force-pushed the tickets/DM-39343 branch 2 times, most recently from 21f9baf to 1a1b00c Compare June 1, 2023 23:20
@cbanek
Copy link
Contributor Author

cbanek commented Jun 5, 2023

ready for another look

@gpdf
Copy link
Collaborator

gpdf commented Jun 7, 2023

I've looked at this and have a couple of questions for Fritz which I will try to resolve tomorrow (Wednesday) morning.

@cbanek
Copy link
Contributor Author

cbanek commented Jun 7, 2023

I've added sso deployments

@cbanek cbanek merged commit bf0c79d into main Jun 7, 2023
2 of 3 checks passed
@cbanek cbanek deleted the tickets/DM-39343 branch June 7, 2023 22:11
Copy link
Collaborator

@gpdf gpdf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK to proceed now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants