-
Notifications
You must be signed in to change notification settings - Fork 34
Open Data Hub Community Meeting Agenda
- Video Conferencing using bluejeans: https://bluejeans.com/222067203
- Audio Call:
- Dial one of the following numbers:
- 408-915-6466 (United States)
- For international numbers please visit bluejeans
- Enter the meeting ID 222067203 #
Edit this Wiki page and place your items under the "Agenda" title for the specific meeting. If you do not see an "Edit" button please request access to the Open Data Hub Community project.
Meeting Recording: https://bluejeans.com/s/0dKMAaipmeB/
- ODH 1.1 updates:
- KF Manifest restructuring broke ODH example kfdefs in ODH operator description issue.
- odh-manifest bug fixes.
- Waiting on KF March 15th first cut.
- ODH weekly Z-Stream release for odh-manifest/operator
- ODH project planning moving to Jira
- JH New Spawner (Maros)
- Operator Level 4 (Edmund and Landon)
Meeting Recording: https://bluejeans.com/s/lO1hesxebeK/
- ODH v1.0 update (Landon)
- Kubeflow_Disconnected_-_Notes.pdf(Vasek)
- Ray ODH demo:https://github.com/erikerlandson/ray-odh-demo (Erik)Ray-on-ODH-Feb-2021.pdf
Meeting Recording: https://bluejeans.com/s/oCg5iCv4cGj/
- ODH 1.0 Release Updates:
- New target data for release Jan 29th
- KFServing & KF Pipeline using Tekton PR
- JH volume sharing
- Updated documentation for GPU install
- New Documentation on JH Custom Notebooks
- Updated Argo release to 2.12.15
- ODH on MOC (Marcel) slidesOperate_First_-_ODH_Community_Meeting.pdf
Meeting Recording: https://bluejeans.com/s/eeGaWj7OJOU/
- ODH 1.0 Release Updates:
- JH Spawner
- KFServing
- KF Pipeline on Tekton
- Data Catalog: Thrift Server, Hue (Tom)
- Multinamespace Monitoring (Anish, Humair)
Meeting Recording: https://bluejeans.com/s/fMmEEr5R@jU/
- ODH 1.0 Release Updates:
- opendatahub.io documentations (Issues with mixing and GPU)
- JH Spawner
- Data Catalog PRs
- Data Skipping Library (Paula)
- No meeting Dec 28th, HAPPY HOLIDAYS
Meeting Recording: https://bluejeans.com/s/4asJSf6uuWF/
- ODH Release Updates:
- ODH v0.9: Released. OCP Stack on KF, Elyra v1.3.3, Ceph-Nano, ODH Portal, JH and Kafka Monitoring. JH Spawner (minor release)
- ODH v1.0: Disconnected Install, KF on Tekton, KFServing, Data Catalog (Thrift Server, Hue), JH Volume Sharing, CI/CD testing, Monitoring, Documentation)
- Kubeflow on Premise (Michael)
- ODH multi-namespace install (Vasek and Tom)
- Ceph-Nano (Landon)
Meeting Recording: https://bluejeans.com/s/cdUeLngxmjX/
- ODH v0.9 updates
- YuniKorn, spark batch management (Weiwei)
Meeting Recording: https://bluejeans.com/s/izF69885D8y/
-
ODH v 0.9 updates
-
Thoth Station (Harshad)
Meeting Recording: https://bluejeans.com/s/Rk8k6J5UKQc/
- ODH v0.8: JupyterHub, Elyra, Monitoring Kubeflow 1.0, Pytorchjobs + ODH, CI/CD
- Jupyter Image builds and Elyra (Vasek)
- Dataset Lifecycle Framework (Yiannis Gkoufas)
Meeting Recording: https://bluejeans.com/s/CbTGSPO53Q6
- ODH 0.8 updates
- Added Monitoring to KF with Prometheus and Grafana, enabled Argo prometheus endpoints.
- Replacing JH images with ones that include Thoth
- SPIKE Minimum Object Storage to replace ceph nano
- Adding ODH operator for openshift-ci testing
- ODH portal and opendatahub.io migration to github
- New Blog: From notebooks to pipelines: Using Open Data Hub and Kubeflow on OpenShift
- Kubeflow_Pipelines_on_OCP.pdf (Juana)
- KubeflowPipelines-Tekton-Dojo.pdf.zip (Animesh)
- Shared_resources_in_JupyterHub_with_RWX.pdf (Guillaume)
Meeting Recording: https://bluejeans.com/s/Iscv9/
- ODH updates
- ODH 0.7 published in OperatorHub
- Open Data Hub and Kubeflow installation customization (Vasek)
- ODH 0.8 current work
- Mixing ODH and Kubeflow: ODH + PyTorch-jobs, KF + Prometheus and Grafana (Juana)
- Continuous rebase of forked repos (Landon)
- CI/CD (Chad)
- Open Data Hub at Red Hat (Alex and Anish)
Meeting Recording: https://bluejeans.com/s/jkgg_/
- Notebooks to Pipelines
- Nachlass: https://github.com/nachlass-tools/nachlass (William)
- Elyra: https://github.com/elyra-ai/elyra (Luciano)
- Open Data Hub 0.7 release update.
Meeting Recording: https://bluejeans.com/s/HUYVf
- ODH 0.7 updates
- Completed most of the testing tasks
- KF 1.0: JH, Seldon, Katib, Pipelines
- Documentation, Guidelines and Demos
- opendatahub.io and ODH 0.6.1 blogs (https://developers.redhat.com/blog/tag/open-data-hub/)
- How to add Custom JH Images
- How to Customize ODH Components
- DevNation (https://developers.redhat.com/devnation/tech-talks/kubeflow-kubernetes/) and Developer Conference (thedevconf.com)
- CI Testing update (Chad)
- JupyterHub Single User Profile API and UI (https://github.com/opendatahub-io/jupyterhub-singleuser-profiles/pull/39) (Maros) Notes: Is it possible to display storage or pvc? This is based on JH used by resources, it is possible to add them, we have to think about what makes sense?. Adding Language support? Vasek: please open issues for all ideas. Question on implementing multiple profile UI, Data Scientists UI and Admin UI? Vasek, we need to tie it to OCP groups and user auth. and set the configmap to provide different profiles. Something to add in the future.
- ODH On the Edge Use Case (Landon)
Meeting Recording: https://bluejeans.com/s/Wj7fS/
- ODH 0.6.1 updates (Landon)
- ODH Roadmap (Vasek)
- ODH dashboard UI (Guillaume)https://github.com/guimou/odh-dashboard
Meeting Recording: https://bluejeans.com/s/kTip6
- ODH Updates
- Projects
- ODH 0.6.1: Most documentation PRs and certified Seldon operator v1.1.0 are done.
- PRs in review: #8, #21, #44. Track project
- kfctl operator: Rebasing to fix issues with multiple installs and namespace delete. Discussions on operator versioning, kfctl versioning, github tags and releases. Issues operator versioning does not correspond to github TAG or branch in kfctl repo. Workflow update (Landon)
- CI and ODH Continuous Deployment project (Chad)
- Argo vs Airflow vs Tekton feature review (Vedant)
Meeting Recording: https://bluejeans.com/s/1ATGH
- ODH 0.6.0 and 0.6.1 (Landon and Juana) Discussion on mixing ODH and KF components and allowing different flavors of kfDef depending on the usecase. Discussion on enabling integration with Red Hat products and making it easier for the user to enable it.
- Argo Events (Tom Coufal)Argo-Events_demo_for_ODH_community.pdf Many questions on how Argo events compares to Knative events(https://knative.dev/docs/eventing/) and Cloud Events (https://cloudevents.io/). Argo events provides an option to bundle events that was not available in other tools. Next step is to wait for a stable Argo Events 1.0 release.
Meeting Recording: https://bluejeans.com/222067203
-
ODH current status (Juana).
Components currently migrated.
a. Merged: AI Library, Prometheus/Grafana, Spark, Superset.
b. In Review: JupyterHub, Airflow, Argo 2.7.
Components that need migration.
a. Data Catalog: Hive Meta Store, Spark SQL Thrift Server, Hue.
Last step by end of April, customize KF/kfctl operator submit a PR for OCP OperatorHub Community Operators. The new ODH operator will have two channels: ODH 0.5.x (Ansible), ODH 0.6.x (kfctl). -
ODH Roadmap (Vasek) Slides: ODH_Roadmap__draft_.pdf
-
Airflow (Vedant) Slides: Airflow_in_OpenDataHub_Demo.pdf
Meeting Recording: https://bluejeans.com/s/mXTsb/
- Red Hat Openshift Service Mesh integrated with Kubeflow 0.7 (Juana)
- Added Network Policy, ServiceMeshMemberroll creation, service mesh rbac, kfdef/kfctl_openshift-servicemesh.yaml
- Issues: Automation of RHOSM installation, adding KF profile controller created namespaces to ServiceMeshMemberroll, Kiali kubeflow namespace issues, cleaning install on delete.
- Open Data Hub Operator discussion, demo and transition (Landon) Discussion included informing the KF community on ODH plans to use KF/kfctl operator, sending email and opening an issue. Discussions on specifying version of other operators the ODH operator depends on.
- kfctl/Kustomize issues (Chad)
- Variables
- Latest version
- Anonymous namespace Discussion on involving the Kustomize community to help solve these issues.
Meeting Recording: https://bluejeans.com/s/fBQ61
- ODH 0.5.1 update (Landon) a. Spark Master/Client resource requests
- ODH migration plan (Juana) a. ODH 0.5.x is the last Ansible based operator b. ODH 0.6.x plan to migrate to Kubeflow kfctl operator. This option includes migrating current ODH components to kfdef manifests and retention decisions on redundant components.
- Great Expectations (Abe) Action: Juana to open an issue to track integration: https://gitlab.com/opendatahub/opendatahub-operator/-/issues/197
Meeting Recording: https://bluejeans.com/s/1xWYI
- Kubeflow 0.7 on OCP 4.2 update
- ODH 0.5.1 (Landon)
- MRs that need reviews: !98, !95, !63
- MLflow (Boris)
- Action Item: opened an issue to continue discussion: https://gitlab.com/opendatahub/opendatahub-operator/issues/161
- Proposal for rebasing ODH deployment method (Vasek)
- Slides: https://docs.google.com/presentation/d/1_q9Y976LlxSrqvXXgwbKCSHSrMPEf_UGvZooRFUZGyw/edit?usp=sharing
- Operator discussion (Animesh).
- Action Item: To continue discussion next meeting and Animesh to present the operator.
Meeting Recording: https://bluejeans.com/s/we5WN
- ODH 0.5 update - Landon
- AICoE-Jupyterhub - Documentation for GPU Enablement and enabling a GPU for a Jupyter notebook pod
- Data Catalog - Tutorial on Data Collection using Data Catalog
- Superset - Deploying Superset
- Kubeflow 0.7 on OCP 4.2 update
- documentation will be published this week
- To install today
git clone https://github.com/opendatahub-io/manifests.git cd manifests sed -i 's#uri: .*#uri: '$PWD'#' ./kfdef/kfctl_openshift.yaml kfctl build --file=kfdef/kfctl_openshift.yaml kfctl apply --file=./kfdef/kfctl_openshift.yaml
- Two issues currently being worked on
- Katib metric collection and RH service mesh (https://github.com/opendatahub-io/manifests/pull/8) - Juana
- Tensorboard and pipelines - Chad
- Kubeflow integration with both cloudflow (Lightbend product) and MLflow (Boris)
Meeting Recording: https://bluejeans.com/s/VDt0u
- Cortex Certifai (Sanjay)
- ODPI Egria (Mandy)
- Jupyter Enterprise Gateway (Luciano) Slides
Meeting Recording: https://bluejeans.com/s/91nwK
- ODH 0.5.0 Release Update
- ODH 0.6 proposed features
- Kubeflow effort
Meeting Recording: https://bluejeans.com/s/bVzMQ
- ODH Release 0.5.0 update (Juana and Landon)
- Superset demo (Juana)
- Data Catalog (Landon)
- AI Library Demo (Prasanth)
- Open Floor Discussions
Meeting Recording: https://bluejeans.com/s/o6IdB/
- Welcome (Juana)
- ODH 0.5 Update (Landon)
- Open Floor Discussion
- Kubeflow + Open Data Hub (Vaclav)
- Overview of ODH objectives with Kubeflow
- ODH community contributing improvements to Kubeflow
- Plan for making Kubeflow work on OpenShift