-
Notifications
You must be signed in to change notification settings - Fork 34
Open Data Hub Community Meeting Agenda
- Video Conferencing using bluejeans: https://bluejeans.com/563715630/3948
- Audio Call:
- Dial one of the following numbers:
- 408-915-6466 (United States)
- For international numbers please visit bluejeans
- Enter the meeting ID 563715630 #
Below is deprecated. Agenda updates can be made here: https://docs.google.com/document/d/1u6Kwn_uBwrlYnEE1wBkK-7USXCFuD_0IU8gKhGdfuuw/edit#
- OpenVINO (Ryan)
- Data Governance discussion (Ricardo Martinelli)
Meeting Recording: https://bluejeans.com/s/QtY6Hoy_jIY/
- ODH Updates:
- ODH Community Meeting moved to monthly (Every 3rd Monday)
- ODH v1.2.0 tasks added. Active Sprint 10.
- ODH Sprints cadence every 4 weeks, calendar.
- Where is KF OCP 1.4 stack work happening? https://github.com/opendatahub-io
- How do I chat with ODH members? On KF Slack channel: platform-openshift
- JupyterHub HA (Maulik)
- Project Meteor (Tom/Isabel)
Meeting Recording: https://bluejeans.com/s/Hm8z866J_RW/
Meeting Recording: https://bluejeans.com/s/5q9U4wtfC46/
- ODH v1.1.0 update- Fix for KF 1.3 tag based manifest pull, Release Announcement, Documentation (Juana)
- ODH Component Contribution Guidelines (Juana)
- ODH Image and Build file locations (Landon)
- Machine Learning Exchange (MLX) (Animesh)
Meeting Recording: https://bluejeans.com/s/NgTrwYdCrT1/
- ODH v 1.1.0 release slated for June 17th
- Waiting on Operator PR: https://github.com/opendatahub-io/opendatahub-operator/pull/126
- ODH Operator Level 4 and new channel update
- JH New Spawner UI
- Superset Upgrade to 1.1.0
- Updated JH Grafana Dashboard
- ODH issues migrating to Jira: https://issues.redhat.com/projects/ODH/
- Trino (Maulik)
- User Authentication on ODH + KF on OCP (Ricardo)
Meeting Recording: https://bluejeans.com/s/_aFDJqz682i/
- ODH issues migrating to Jira: https://issues.redhat.com/projects/ODH/issues/ODH-380?filter=allopenissues. Action item: please migrate any issue you opened in the next two weeks. Github issues Tab will be disabled.
- Kubeflow 1.3 updates
- Openshift distribution officially part of KF 1.3 release, specifically on OCP 4.5
- KF 1.3 on OCP 4.6/4.7 has issues documented here: https://github.com/kubeflow/manifests/issues/1867 . WIP PR to address these issues and provide an OCP profile controller image is here: https://github.com/opendatahub-io/kubeflow/pull/1
- KF 1.3 features that still needs to be added: multi-user pipelines, tensorboard
- All Kubeflow OCP work will be downstream in opendatahub-io
- ODH Operator Level 4 and new channel update (Landon)
- ODH Z-stream cadence moving to 2weeks.
- ODH new features
- Trino: An Open Source project of Starburst Presto, a distributed SQL Analytical database that can integrate with multiple data sources.https://github.com/opendatahub-io/odh-manifests/tree/master/trino
- Elyra to version 2.2.4
- Strimzi Kafka Operator to v0.22
- JupyterHub to v0.2.8
- OpenShift Pipelines to v1.3.1
Meeting Recording: https://bluejeans.com/s/MmgAqsArCvr
-
Github Migration Complete. Community site moved to: https://github.com/opendatahub-io/opendatahub-community
-
ODH 1.1.0 Updates:
- Kubeflow 1.3 waiting for first cut
- Operator Level 4 (Landon)
- ODH Dashboard now has OCP oauth in an overlay
- JupyterHub image update, Overlay for setting Postgres password, Allow Groups configuration, Spawner UI updates
-
How Red Hat IT uses ODH to enable Self Service Analytics (Will)
-
Elyra + Airflow (Alan)
Meeting Recording: https://bluejeans.com/s/0dKMAaipmeB/
- ODH 1.1 updates:
- KF Manifest restructuring broke ODH example kfdefs in ODH operator description issue.
- odh-manifest bug fixes.
- Waiting on KF March 15th first cut.
- ODH weekly Z-Stream release for odh-manifest/operator
- ODH project planning moving to Jira
- JH New Spawner (Maros)
- Operator Level 4 (Edmund and Landon)
Meeting Recording: https://bluejeans.com/s/lO1hesxebeK/
- ODH v1.0 update (Landon)
- Kubeflow_Disconnected_-_Notes.pdf(Vasek)
- Ray ODH demo:https://github.com/erikerlandson/ray-odh-demo (Erik)Ray-on-ODH-Feb-2021.pdf
Meeting Recording: https://bluejeans.com/s/oCg5iCv4cGj/
- ODH 1.0 Release Updates:
- New target data for release Jan 29th
- KFServing & KF Pipeline using Tekton PR
- JH volume sharing
- Updated documentation for GPU install
- New Documentation on JH Custom Notebooks
- Updated Argo release to 2.12.15
- ODH on MOC (Marcel) slidesOperate_First_-_ODH_Community_Meeting.pdf
Meeting Recording: https://bluejeans.com/s/eeGaWj7OJOU/
- ODH 1.0 Release Updates:
- JH Spawner
- KFServing
- KF Pipeline on Tekton
- Data Catalog: Thrift Server, Hue (Tom)
- Multinamespace Monitoring (Anish, Humair)
Meeting Recording: https://bluejeans.com/s/fMmEEr5R@jU/
- ODH 1.0 Release Updates:
- opendatahub.io documentations (Issues with mixing and GPU)
- JH Spawner
- Data Catalog PRs
- Data Skipping Library (Paula)
- No meeting Dec 28th, HAPPY HOLIDAYS
Meeting Recording: https://bluejeans.com/s/4asJSf6uuWF/
- ODH Release Updates:
- ODH v0.9: Released. OCP Stack on KF, Elyra v1.3.3, Ceph-Nano, ODH Portal, JH and Kafka Monitoring. JH Spawner (minor release)
- ODH v1.0: Disconnected Install, KF on Tekton, KFServing, Data Catalog (Thrift Server, Hue), JH Volume Sharing, CI/CD testing, Monitoring, Documentation)
- Kubeflow on Premise (Michael)
- ODH multi-namespace install (Vasek and Tom)
- Ceph-Nano (Landon)
Meeting Recording: https://bluejeans.com/s/cdUeLngxmjX/
- ODH v0.9 updates
- YuniKorn, spark batch management (Weiwei)
Meeting Recording: https://bluejeans.com/s/izF69885D8y/
-
ODH v 0.9 updates
-
Thoth Station (Harshad)
Meeting Recording: https://bluejeans.com/s/Rk8k6J5UKQc/
- ODH v0.8: JupyterHub, Elyra, Monitoring Kubeflow 1.0, Pytorchjobs + ODH, CI/CD
- Jupyter Image builds and Elyra (Vasek)
- Dataset Lifecycle Framework (Yiannis Gkoufas)
Meeting Recording: https://bluejeans.com/s/CbTGSPO53Q6
- ODH 0.8 updates
- Added Monitoring to KF with Prometheus and Grafana, enabled Argo prometheus endpoints.
- Replacing JH images with ones that include Thoth
- SPIKE Minimum Object Storage to replace ceph nano
- Adding ODH operator for openshift-ci testing
- ODH portal and opendatahub.io migration to github
- New Blog: From notebooks to pipelines: Using Open Data Hub and Kubeflow on OpenShift
- Kubeflow_Pipelines_on_OCP.pdf (Juana)
- KubeflowPipelines-Tekton-Dojo.pdf (Animesh)
- Shared_resources_in_JupyterHub_with_RWX.pdf (Guillaume)
Meeting Recording: https://bluejeans.com/s/Iscv9/
- ODH updates
- ODH 0.7 published in OperatorHub
- Open Data Hub and Kubeflow installation customization (Vasek)
- ODH 0.8 current work
- Mixing ODH and Kubeflow: ODH + PyTorch-jobs, KF + Prometheus and Grafana (Juana)
- Continuous rebase of forked repos (Landon)
- CI/CD (Chad)
- Open Data Hub at Red Hat (Alex and Anish)
Meeting Recording: https://bluejeans.com/s/jkgg_/
- Notebooks to Pipelines
- Nachlass: https://github.com/nachlass-tools/nachlass (William)
- Elyra: https://github.com/elyra-ai/elyra (Luciano)
- Open Data Hub 0.7 release update.
Meeting Recording: https://bluejeans.com/s/HUYVf
- ODH 0.7 updates
- Completed most of the testing tasks
- KF 1.0: JH, Seldon, Katib, Pipelines
- Documentation, Guidelines and Demos
- opendatahub.io and ODH 0.6.1 blogs (https://developers.redhat.com/blog/tag/open-data-hub/)
- How to add Custom JH Images
- How to Customize ODH Components
- DevNation (https://developers.redhat.com/devnation/tech-talks/kubeflow-kubernetes/) and Developer Conference (thedevconf.com)
- CI Testing update (Chad)
- JupyterHub Single User Profile API and UI (https://github.com/opendatahub-io/jupyterhub-singleuser-profiles/pull/39) (Maros) Notes: Is it possible to display storage or pvc? This is based on JH used by resources, it is possible to add them, we have to think about what makes sense?. Adding Language support? Vasek: please open issues for all ideas. Question on implementing multiple profile UI, Data Scientists UI and Admin UI? Vasek, we need to tie it to OCP groups and user auth. and set the configmap to provide different profiles. Something to add in the future.
- ODH On the Edge Use Case (Landon)
Meeting Recording: https://bluejeans.com/s/Wj7fS/
- ODH 0.6.1 updates (Landon)
- ODH Roadmap (Vasek)
- ODH dashboard UI (Guillaume)https://github.com/guimou/odh-dashboard
Meeting Recording: https://bluejeans.com/s/kTip6
- ODH Updates
- Projects
- ODH 0.6.1: Most documentation PRs and certified Seldon operator v1.1.0 are done.
- PRs in review: #8, #21, #44. Track project
- kfctl operator: Rebasing to fix issues with multiple installs and namespace delete. Discussions on operator versioning, kfctl versioning, github tags and releases. Issues operator versioning does not correspond to github TAG or branch in kfctl repo. Workflow update (Landon)
- CI and ODH Continuous Deployment project (Chad)
- Argo vs Airflow vs Tekton feature review (Vedant)
Meeting Recording: https://bluejeans.com/s/1ATGH
- ODH 0.6.0 and 0.6.1 (Landon and Juana) Discussion on mixing ODH and KF components and allowing different flavors of kfDef depending on the usecase. Discussion on enabling integration with Red Hat products and making it easier for the user to enable it.
- Argo Events (Tom Coufal)Argo-Events_demo_for_ODH_community.pdf Many questions on how Argo events compares to Knative events(https://knative.dev/docs/eventing/) and Cloud Events (https://cloudevents.io/). Argo events provides an option to bundle events that was not available in other tools. Next step is to wait for a stable Argo Events 1.0 release.
Meeting Recording: https://bluejeans.com/222067203
-
ODH current status (Juana).
Components currently migrated.
a. Merged: AI Library, Prometheus/Grafana, Spark, Superset.
b. In Review: JupyterHub, Airflow, Argo 2.7.
Components that need migration.
a. Data Catalog: Hive Meta Store, Spark SQL Thrift Server, Hue.
Last step by end of April, customize KF/kfctl operator submit a PR for OCP OperatorHub Community Operators. The new ODH operator will have two channels: ODH 0.5.x (Ansible), ODH 0.6.x (kfctl). -
ODH Roadmap (Vasek) Slides: ODH_Roadmap__draft_.pdf
-
Airflow (Vedant) Slides: Airflow_in_OpenDataHub_Demo.pdf
Meeting Recording: https://bluejeans.com/s/mXTsb/
- Red Hat Openshift Service Mesh integrated with Kubeflow 0.7 (Juana)
- Added Network Policy, ServiceMeshMemberroll creation, service mesh rbac, kfdef/kfctl_openshift-servicemesh.yaml
- Issues: Automation of RHOSM installation, adding KF profile controller created namespaces to ServiceMeshMemberroll, Kiali kubeflow namespace issues, cleaning install on delete.
- Open Data Hub Operator discussion, demo and transition (Landon) Discussion included informing the KF community on ODH plans to use KF/kfctl operator, sending email and opening an issue. Discussions on specifying version of other operators the ODH operator depends on.
- kfctl/Kustomize issues (Chad)
- Variables
- Latest version
- Anonymous namespace Discussion on involving the Kustomize community to help solve these issues.
Meeting Recording: https://bluejeans.com/s/fBQ61
- ODH 0.5.1 update (Landon) a. Spark Master/Client resource requests
- ODH migration plan (Juana) a. ODH 0.5.x is the last Ansible based operator b. ODH 0.6.x plan to migrate to Kubeflow kfctl operator. This option includes migrating current ODH components to kfdef manifests and retention decisions on redundant components.
- Great Expectations (Abe) Action: Juana to open an issue to track integration: https://gitlab.com/opendatahub/opendatahub-operator/-/issues/197
Meeting Recording: https://bluejeans.com/s/1xWYI
- Kubeflow 0.7 on OCP 4.2 update
- ODH 0.5.1 (Landon)
- MRs that need reviews: !98, !95, !63
- MLflow (Boris)
- Action Item: opened an issue to continue discussion: https://gitlab.com/opendatahub/opendatahub-operator/issues/161
- Proposal for rebasing ODH deployment method (Vasek)
- Slides: https://docs.google.com/presentation/d/1_q9Y976LlxSrqvXXgwbKCSHSrMPEf_UGvZooRFUZGyw/edit?usp=sharing
- Operator discussion (Animesh).
- Action Item: To continue discussion next meeting and Animesh to present the operator.
Meeting Recording: https://bluejeans.com/s/we5WN
- ODH 0.5 update - Landon
- AICoE-Jupyterhub - Documentation for GPU Enablement and enabling a GPU for a Jupyter notebook pod
- Data Catalog - Tutorial on Data Collection using Data Catalog
- Superset - Deploying Superset
- Kubeflow 0.7 on OCP 4.2 update
- documentation will be published this week
- To install today
git clone https://github.com/opendatahub-io/manifests.git cd manifests sed -i 's#uri: .*#uri: '$PWD'#' ./kfdef/kfctl_openshift.yaml kfctl build --file=kfdef/kfctl_openshift.yaml kfctl apply --file=./kfdef/kfctl_openshift.yaml
- Two issues currently being worked on
- Katib metric collection and RH service mesh (https://github.com/opendatahub-io/manifests/pull/8) - Juana
- Tensorboard and pipelines - Chad
- Kubeflow integration with both cloudflow (Lightbend product) and MLflow (Boris)
Meeting Recording: https://bluejeans.com/s/VDt0u
- Cortex Certifai (Sanjay)
- ODPI Egria (Mandy)
- Jupyter Enterprise Gateway (Luciano) Slides
Meeting Recording: https://bluejeans.com/s/91nwK
- ODH 0.5.0 Release Update
- ODH 0.6 proposed features
- Kubeflow effort
Meeting Recording: https://bluejeans.com/s/bVzMQ
- ODH Release 0.5.0 update (Juana and Landon)
- Superset demo (Juana)
- Data Catalog (Landon)
- AI Library Demo (Prasanth)
- Open Floor Discussions
Meeting Recording: https://bluejeans.com/s/o6IdB/
- Welcome (Juana)
- ODH 0.5 Update (Landon)
- Open Floor Discussion
- Kubeflow + Open Data Hub (Vaclav)
- Overview of ODH objectives with Kubeflow
- ODH community contributing improvements to Kubeflow
- Plan for making Kubeflow work on OpenShift