Open Data Hub Community Meeting Agenda

Open Data Hub Community Meetings

To Join

1. Video Conferencing using bluejeans: https://bluejeans.com/563715630/3948
2. Audio Call:
   • Dial one of the following numbers:
   • 408-915-6466 (United States)
   • For international numbers please visit bluejeans
   • Enter the meeting ID 563715630 #

To Add Agenda Items

Below is deprecated. Agenda updates can be made here: https://docs.google.com/document/d/1u6Kwn_uBwrlYnEE1wBkK-7USXCFuD_0IU8gKhGdfuuw/edit#

Meetings

Monday September 20th, 2021

Meeting Recording: TBD

Agenda:

1. OpenVINO (Ryan)
2. Data Governance discussion (Ricardo Martinelli)

Monday August 23rd, 2021

Meeting Recording: https://bluejeans.com/s/QtY6Hoy_jIY/

Agenda:

1. ODH Updates:

• ODH Community Meeting moved to monthly (Every 3rd Monday)
• ODH v1.2.0 tasks added. Active Sprint 10.
• ODH Sprints cadence every 4 weeks, calendar.
• Where is KF OCP 1.4 stack work happening? https://github.com/opendatahub-io
• How do I chat with ODH members? On KF Slack channel: platform-openshift

2. JupyterHub HA (Maulik)
3. Project Meteor (Tom/Isabel)

Monday July 26th, 2021

Meeting Recording: https://bluejeans.com/s/Hm8z866J_RW/

Agenda:

1. ODH v1.1.0 update. Release notes and blog
2. ODH Q3/Q4 Roadmap (Juana)
3. ODH UI/UX (Jeff)

Monday July 12th, 2021

Meeting Recording: https://bluejeans.com/s/5q9U4wtfC46/

Agenda:

1. ODH v1.1.0 update- Fix for KF 1.3 tag based manifest pull, Release Announcement, Documentation (Juana)
2. ODH Component Contribution Guidelines (Juana)
3. ODH Image and Build file locations (Landon)
4. Machine Learning Exchange (MLX) (Animesh)

Monday June 14th, 2021

Meeting Recording: https://bluejeans.com/s/NgTrwYdCrT1/

Agenda:

1. ODH v 1.1.0 release slated for June 17th

• Waiting on Operator PR: https://github.com/opendatahub-io/opendatahub-operator/pull/126
• ODH Operator Level 4 and new channel update
• JH New Spawner UI
• Superset Upgrade to 1.1.0
• Updated JH Grafana Dashboard

2. ODH issues migrating to Jira: https://issues.redhat.com/projects/ODH/
3. Trino (Maulik)
4. User Authentication on ODH + KF on OCP (Ricardo)

Monday May 17th, 2021

Meeting Recording: https://bluejeans.com/s/_aFDJqz682i/

Agenda:

1. ODH issues migrating to Jira: https://issues.redhat.com/projects/ODH/issues/ODH-380?filter=allopenissues. Action item: please migrate any issue you opened in the next two weeks. Github issues Tab will be disabled.
2. Kubeflow 1.3 updates

• Openshift distribution officially part of KF 1.3 release, specifically on OCP 4.5
• KF 1.3 on OCP 4.6/4.7 has issues documented here: https://github.com/kubeflow/manifests/issues/1867 . WIP PR to address these issues and provide an OCP profile controller image is here: https://github.com/opendatahub-io/kubeflow/pull/1
• KF 1.3 features that still needs to be added: multi-user pipelines, tensorboard

3. All Kubeflow OCP work will be downstream in opendatahub-io
4. ODH Operator Level 4 and new channel update (Landon)
5. ODH Z-stream cadence moving to 2weeks.
6. ODH new features

• Trino: An Open Source project of Starburst Presto, a distributed SQL Analytical database that can integrate with multiple data sources.https://github.com/opendatahub-io/odh-manifests/tree/master/trino
• Elyra to version 2.2.4
• Strimzi Kafka Operator to v0.22
• JupyterHub to v0.2.8
• OpenShift Pipelines to v1.3.1

Monday April 5th, 2021

Meeting Recording: https://bluejeans.com/s/MmgAqsArCvr

Agenda:

1. Github Migration Complete. Community site moved to: https://github.com/opendatahub-io/opendatahub-community

2. ODH 1.1.0 Updates:

   • Kubeflow 1.3 waiting for first cut
   • Operator Level 4 (Landon)
   • ODH Dashboard now has OCP oauth in an overlay
   • JupyterHub image update, Overlay for setting Postgres password, Allow Groups configuration, Spawner UI updates

3. How Red Hat IT uses ODH to enable Self Service Analytics (Will)

4. Elyra + Airflow (Alan)

Monday March 8th, 2021

Meeting Recording: https://bluejeans.com/s/0dKMAaipmeB/

Agenda:

1. ODH 1.1 updates:

• KF Manifest restructuring broke ODH example kfdefs in ODH operator description issue.
• odh-manifest bug fixes.
• Waiting on KF March 15th first cut.

2. ODH weekly Z-Stream release for odh-manifest/operator
3. ODH project planning moving to Jira
4. JH New Spawner (Maros)
5. Operator Level 4 (Edmund and Landon)

Monday February 8th, 2021

Meeting Recording: https://bluejeans.com/s/lO1hesxebeK/

Agenda:

1. ODH v1.0 update (Landon)
2. Kubeflow_Disconnected_-_Notes.pdf(Vasek)
3. Ray ODH demo:https://github.com/erikerlandson/ray-odh-demo (Erik)Ray-on-ODH-Feb-2021.pdf

Monday January 25th, 2021

Meeting Recording: https://bluejeans.com/s/oCg5iCv4cGj/

Agenda:

1. ODH 1.0 Release Updates:

• New target data for release Jan 29th
• KFServing & KF Pipeline using Tekton PR
• JH volume sharing
• Updated documentation for GPU install
• New Documentation on JH Custom Notebooks
• Updated Argo release to 2.12.15

2. ODH on MOC (Marcel) slidesOperate_First_-_ODH_Community_Meeting.pdf

Monday January 11th, 2021

Meeting Recording: https://bluejeans.com/s/eeGaWj7OJOU/

Agenda:

1. ODH 1.0 Release Updates:

• JH Spawner
• KFServing
• KF Pipeline on Tekton

2. Data Catalog: Thrift Server, Hue (Tom)
3. Multinamespace Monitoring (Anish, Humair)

Monday Dec 14th, 2020

Meeting Recording: https://bluejeans.com/s/fMmEEr5R@jU/

Agenda:

1. ODH 1.0 Release Updates:

• opendatahub.io documentations (Issues with mixing and GPU)
• JH Spawner
• Data Catalog PRs

2. Data Skipping Library (Paula)
3. No meeting Dec 28th, HAPPY HOLIDAYS

Monday Nov 16th, 2020

Meeting Recording: https://bluejeans.com/s/4asJSf6uuWF/

Agenda:

1. ODH Release Updates:

• ODH v0.9: Released. OCP Stack on KF, Elyra v1.3.3, Ceph-Nano, ODH Portal, JH and Kafka Monitoring. JH Spawner (minor release)
• ODH v1.0: Disconnected Install, KF on Tekton, KFServing, Data Catalog (Thrift Server, Hue), JH Volume Sharing, CI/CD testing, Monitoring, Documentation)

2. Kubeflow on Premise (Michael)
3. ODH multi-namespace install (Vasek and Tom)
4. Ceph-Nano (Landon)

Monday Oct 19th, 2020

Meeting Recording: https://bluejeans.com/s/cdUeLngxmjX/

Agenda:

1. ODH v0.9 updates

• ODH portal
• ODH Kustomize v3: Openshift stack
• Elyra version update
• Ceph-nano and ODH disconnected.

2. YuniKorn, spark batch management (Weiwei)

Monday Oct 5th, 2020

Meeting Recording: https://bluejeans.com/s/izF69885D8y/

Agenda:

1. ODH v 0.9 updates

   • ODH manifest moving to Kustomize v3, adding Openshift stack
   • ODH v0.8 operator legacy issue (Landon)
   • Elyra to version v1.2.1 (Vasek and Alan)
   • Adding Tekton pipeline build to operator manifest (Chad)

2. Thoth Station (Harshad)

Monday Sept 21st, 2020

Meeting Recording: https://bluejeans.com/s/Rk8k6J5UKQc/

Agenda:

1. ODH v0.8: JupyterHub, Elyra, Monitoring Kubeflow 1.0, Pytorchjobs + ODH, CI/CD
2. Jupyter Image builds and Elyra (Vasek)
3. Dataset Lifecycle Framework (Yiannis Gkoufas)

Monday August 10th, 2020

Meeting Recording: https://bluejeans.com/s/CbTGSPO53Q6

Agenda:

1. ODH 0.8 updates

• Added Monitoring to KF with Prometheus and Grafana, enabled Argo prometheus endpoints.
• Replacing JH images with ones that include Thoth
• SPIKE Minimum Object Storage to replace ceph nano
• Adding ODH operator for openshift-ci testing
• ODH portal and opendatahub.io migration to github
• New Blog: From notebooks to pipelines: Using Open Data Hub and Kubeflow on OpenShift

2. Kubeflow_Pipelines_on_OCP.pdf (Juana)
3. KubeflowPipelines-Tekton-Dojo.pdf (Animesh)
4. Shared_resources_in_JupyterHub_with_RWX.pdf (Guillaume)

Monday July 27th, 2020

Meeting Recording: https://bluejeans.com/s/Iscv9/

Agenda:

1. ODH updates

• ODH 0.7 published in OperatorHub
• Open Data Hub and Kubeflow installation customization (Vasek)
• ODH 0.8 current work
  1. Mixing ODH and Kubeflow: ODH + PyTorch-jobs, KF + Prometheus and Grafana (Juana)
  2. Continuous rebase of forked repos (Landon)
  3. CI/CD (Chad)

2. Open Data Hub at Red Hat (Alex and Anish)

Monday July 13th, 2020

Meeting Recording: https://bluejeans.com/s/jkgg_/

Agenda:

1. Notebooks to Pipelines

• Nachlass: https://github.com/nachlass-tools/nachlass (William)
• Elyra: https://github.com/elyra-ai/elyra (Luciano)

2. Open Data Hub 0.7 release update.

Monday June 29th, 2020

Meeting Recording: https://bluejeans.com/s/HUYVf

Agenda:

1. ODH 0.7 updates

• Completed most of the testing tasks
• KF 1.0: JH, Seldon, Katib, Pipelines
• Documentation, Guidelines and Demos

• opendatahub.io and ODH 0.6.1 blogs (https://developers.redhat.com/blog/tag/open-data-hub/)
• How to add Custom JH Images
• How to Customize ODH Components
• DevNation (https://developers.redhat.com/devnation/tech-talks/kubeflow-kubernetes/) and Developer Conference (thedevconf.com)

2. CI Testing update (Chad)
3. JupyterHub Single User Profile API and UI (https://github.com/opendatahub-io/jupyterhub-singleuser-profiles/pull/39) (Maros) Notes: Is it possible to display storage or pvc? This is based on JH used by resources, it is possible to add them, we have to think about what makes sense?. Adding Language support? Vasek: please open issues for all ideas. Question on implementing multiple profile UI, Data Scientists UI and Admin UI? Vasek, we need to tie it to OCP groups and user auth. and set the configmap to provide different profiles. Something to add in the future.
4. ODH On the Edge Use Case (Landon)

Meetings

Monday June 1st, 2020

Meeting Recording: https://bluejeans.com/s/Wj7fS/

Agenda:

1. ODH 0.6.1 updates (Landon)
2. ODH Roadmap (Vasek)
3. ODH dashboard UI (Guillaume)https://github.com/guimou/odh-dashboard

Monday May 4th, 2020

Meeting Recording: https://bluejeans.com/s/kTip6

Agenda:

1. ODH Updates

• Projects
• ODH 0.6.1: Most documentation PRs and certified Seldon operator v1.1.0 are done.
• PRs in review: #8, #21, #44. Track project
• kfctl operator: Rebasing to fix issues with multiple installs and namespace delete. Discussions on operator versioning, kfctl versioning, github tags and releases. Issues operator versioning does not correspond to github TAG or branch in kfctl repo. Workflow update (Landon)

2. CI and ODH Continuous Deployment project (Chad)
3. Argo vs Airflow vs Tekton feature review (Vedant)

Monday May 4th, 2020

Meeting Recording: https://bluejeans.com/s/1ATGH

Agenda:

1. ODH 0.6.0 and 0.6.1 (Landon and Juana) Discussion on mixing ODH and KF components and allowing different flavors of kfDef depending on the usecase. Discussion on enabling integration with Red Hat products and making it easier for the user to enable it.
2. Argo Events (Tom Coufal)Argo-Events_demo_for_ODH_community.pdf Many questions on how Argo events compares to Knative events(https://knative.dev/docs/eventing/) and Cloud Events (https://cloudevents.io/). Argo events provides an option to bundle events that was not available in other tools. Next step is to wait for a stable Argo Events 1.0 release.

Monday April 6th, 2020

Meeting Recording: https://bluejeans.com/222067203

Agenda:

1. ODH current status (Juana).
   Components currently migrated.
   a. Merged: AI Library, Prometheus/Grafana, Spark, Superset.
   b. In Review: JupyterHub, Airflow, Argo 2.7.
   Components that need migration.
   a. Data Catalog: Hive Meta Store, Spark SQL Thrift Server, Hue.
   Last step by end of April, customize KF/kfctl operator submit a PR for OCP OperatorHub Community Operators. The new ODH operator will have two channels: ODH 0.5.x (Ansible), ODH 0.6.x (kfctl).

2. ODH Roadmap (Vasek) Slides: ODH_Roadmap__draft_.pdf

3. Airflow (Vedant) Slides: Airflow_in_OpenDataHub_Demo.pdf

Monday March 23rd, 2020

Meeting Recording: https://bluejeans.com/s/mXTsb/

Agenda:

1. Red Hat Openshift Service Mesh integrated with Kubeflow 0.7 (Juana)

• Added Network Policy, ServiceMeshMemberroll creation, service mesh rbac, kfdef/kfctl_openshift-servicemesh.yaml
• Issues: Automation of RHOSM installation, adding KF profile controller created namespaces to ServiceMeshMemberroll, Kiali kubeflow namespace issues, cleaning install on delete.

2. Open Data Hub Operator discussion, demo and transition (Landon) Discussion included informing the KF community on ODH plans to use KF/kfctl operator, sending email and opening an issue. Discussions on specifying version of other operators the ODH operator depends on.
3. kfctl/Kustomize issues (Chad)

• Variables
• Latest version
• Anonymous namespace Discussion on involving the Kustomize community to help solve these issues.

Monday Feb 24th, 2020

Meeting Recording: https://bluejeans.com/s/fBQ61

Agenda:

1. ODH 0.5.1 update (Landon) a. Spark Master/Client resource requests
2. ODH migration plan (Juana) a. ODH 0.5.x is the last Ansible based operator b. ODH 0.6.x plan to migrate to Kubeflow kfctl operator. This option includes migrating current ODH components to kfdef manifests and retention decisions on redundant components.
3. Great Expectations (Abe) Action: Juana to open an issue to track integration: https://gitlab.com/opendatahub/opendatahub-operator/-/issues/197

---

Monday Feb 10th, 2020

Meeting Recording: https://bluejeans.com/s/1xWYI

Agenda:

1. Kubeflow 0.7 on OCP 4.2 update
   • blog: https://developers.redhat.com/blog/2020/02/10/installing-kubeflow-v0-7-on-openshift-4-2/
   • documentation: https://opendatahub.io/docs.html
2. ODH 0.5.1 (Landon)
   • MRs that need reviews: !98, !95, !63
3. MLflow (Boris)
   • Action Item: opened an issue to continue discussion: https://gitlab.com/opendatahub/opendatahub-operator/issues/161
4. Proposal for rebasing ODH deployment method (Vasek)
   • Slides: https://docs.google.com/presentation/d/1_q9Y976LlxSrqvXXgwbKCSHSrMPEf_UGvZooRFUZGyw/edit?usp=sharing
   • Operator discussion (Animesh).
   • Action Item: To continue discussion next meeting and Animesh to present the operator.

---

Monday January 27th, 2020

Meeting Recording: https://bluejeans.com/s/we5WN

Agenda:

1. ODH 0.5 update - Landon
   • AICoE-Jupyterhub - Documentation for GPU Enablement and enabling a GPU for a Jupyter notebook pod
   • Data Catalog - Tutorial on Data Collection using Data Catalog
   • Superset - Deploying Superset
2. Kubeflow 0.7 on OCP 4.2 update
   • documentation will be published this week
   • To install today

 git clone https://github.com/opendatahub-io/manifests.git
 cd manifests
 sed -i 's#uri: .*#uri: '$PWD'#' ./kfdef/kfctl_openshift.yaml
 kfctl build --file=kfdef/kfctl_openshift.yaml
 kfctl apply --file=./kfdef/kfctl_openshift.yaml

• Two issues currently being worked on
  • Katib metric collection and RH service mesh (https://github.com/opendatahub-io/manifests/pull/8) - Juana
  • Tensorboard and pipelines - Chad

3. Kubeflow integration with both cloudflow (Lightbend product) and MLflow (Boris)

Monday January 13th, 2020

Meeting Recording: https://bluejeans.com/s/VDt0u

Agenda:

1. Cortex Certifai (Sanjay)
2. ODPI Egria (Mandy)
3. Jupyter Enterprise Gateway (Luciano) Slides

Monday December 30th, 2019

No Meeting, Happy Holidays

Monday December 16th, 2019

Meeting Recording: https://bluejeans.com/s/91nwK

Agenda:

1. ODH 0.5.0 Release Update
2. ODH 0.6 proposed features
3. Kubeflow effort

---

Monday December 2nd, 2019

Meeting Recording: https://bluejeans.com/s/bVzMQ

Agenda:

1. ODH Release 0.5.0 update (Juana and Landon)
2. Superset demo (Juana)
3. Data Catalog (Landon)
4. AI Library Demo (Prasanth)
5. Open Floor Discussions

---

Monday November 18th, 2019

Meeting Recording: https://bluejeans.com/s/o6IdB/

Agenda:

1. Welcome (Juana)
2. ODH 0.5 Update (Landon)
3. Open Floor Discussion
4. Kubeflow + Open Data Hub (Vaclav)
   • Overview of ODH objectives with Kubeflow
   • ODH community contributing improvements to Kubeflow
   • Plan for making Kubeflow work on OpenShift