You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When using Pipelines integration, if we specify a metadata db name that is different than the Kubeflow default of metadb then the metadata like artifacts types will still be pushed to a db named metadb.
Steps To Reproduce
Specify a name different than metadb when setting up the rds db, let's use the db name kubeflow for this example
Install Kubeflow (tested using main branch + manifest v1.4.1)
Notice how the database kubeflow gets created correctly
Create a pipeline run that pushes some artifacts
Eg:
Verify that the artifacts metadata was pushed to kubeflow db
Notice how the db kubeflow does not have a new row in Artifacts
Verify the table Artifacts in metadb database instead
Notice how the metadata was pushed to the metadb database instead.
Expected behavior
I expected the metadata to be uploaded to the kubeflow db.
Environment
Kubernetes version 1.21
Using EKS (yes/no), if so version? yes eks.4
AWS service targeted (S3, RDS, etc.) RDS
Screenshots
Additional context
I could be wrong but I suspect that some changes are required to allow the renaming of the metadata db name.
If we take a look at upstream/apps/pipeline/upstream/base/metadata/base/metadata-grpc-deployment.yaml we see the following :
So it looks like the MYSQL_DATABASE is retrieved from upstream/apps/pipeline/upstream/base/installs/generic/pipeline-install-config.yaml
From this config map we can see that the value is hard coded
mlmdDb: metadb
Maybe we'd need to add mlmdDb as a param in awsconfigs/apps/pipeline/params.env ?
The text was updated successfully, but these errors were encountered:
AlexandreBrown
changed the title
Pipeline metadata db is not populated when running a pipeline
Custom metadata db name is not populated when running a pipeline
Mar 1, 2022
AlexandreBrown
changed the title
Custom metadata db name is not populated when running a pipeline
metadata db name is not populated when running a pipeline
Mar 1, 2022
AlexandreBrown
changed the title
metadata db name is not populated when running a pipeline
Metadata db name is not populated when running a pipeline
Mar 1, 2022
AlexandreBrown
changed the title
Metadata db name is not populated when running a pipeline
Metadata db is not populated when running a pipeline
Mar 1, 2022
AlexandreBrown
changed the title
Metadata db is not populated when running a pipeline
Metadata db is not populated after running a pipeline
Mar 1, 2022
Describe the bug
When using Pipelines integration, if we specify a metadata db name that is different than the Kubeflow default of
metadb
then the metadata like artifacts types will still be pushed to a db namedmetadb
.Steps To Reproduce
metadb
when setting up the rds db, let's use the db namekubeflow
for this examplemain
branch + manifestv1.4.1
)kubeflow
gets created correctlyEg:
Verify that the artifacts metadata was pushed to
kubeflow
dbNotice how the db
kubeflow
does not have a new row inArtifacts
Verify the table
Artifacts
inmetadb
database insteadNotice how the metadata was pushed to the
metadb
database instead.Expected behavior
I expected the metadata to be uploaded to the
kubeflow
db.Environment
Screenshots
Additional context
I could be wrong but I suspect that some changes are required to allow the renaming of the metadata db name.
If we take a look at
upstream/apps/pipeline/upstream/base/metadata/base/metadata-grpc-deployment.yaml
we see the following :So it looks like the
MYSQL_DATABASE
is retrieved fromupstream/apps/pipeline/upstream/base/installs/generic/pipeline-install-config.yaml
From this config map we can see that the value is hard coded
Maybe we'd need to add
mlmdDb
as a param inawsconfigs/apps/pipeline/params.env
?The text was updated successfully, but these errors were encountered: