Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Model Serving endpoints are different when external, and identical when internal #133

Open
erwangranger opened this issue Oct 25, 2023 · 0 comments
Labels
kind/bug Something isn't working

Comments

@erwangranger
Copy link

ODH Component

ODH Dashboard

Current Behavior

When deploying 2 models in a model server, and making it publicly available, the endpoints for each model are clearly different:
image

https://fraud-serving-demo-gitops.apps.cluster-nxrgw.sandbox1188.opentlc.com/v2/models/fraud/infer
vs
https://fraud1-serving-demo-gitops.apps.cluster-nxrgw.sandbox1188.opentlc.com/v2/models/fraud1/infer

However, when switched back to internal only, the displayed endpoints are:

image and image

i.e.
grpc://modelmesh-serving.serving-demo-gitops:8033
and
grpc://modelmesh-serving.serving-demo-gitops:8033

Expected Behavior

I'd expect both options to work in a more similar fashion, and that even when Internal, Model endpoints should be descriptive enough to lead you to the right model.

Steps To Reproduce

Deploy 2 models. Make them external. Observe the URL. Now make the model server internal. Observe the endpoints.

Workaround (if any)

You can tack on /v2/models/fraud1/infer at the end of the internal URL, and I believe that gets you where you need to be.
To be confirmed. I am not an expert.

What browsers are you seeing the problem on? (If applicable)

No response

Open Data Hub Version

RHODS 1.33

Anything else

This is not urgent, and has been like this for a while, so there is no great urgency.
but this might make a nice "first issue" for someone?

@erwangranger erwangranger added the kind/bug Something isn't working label Oct 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
Status: No status
Status: No status
Development

No branches or pull requests

1 participant