[Bug]: Validation framework doesnot validate OSD properly

[gaiksaya]

Describe the bug

We are using validation workflow from this repo to make sure OS and OSD nightlies are valid before deploying them onto the cluster. See workflow here

However, even after successful validation the OpenSearch Dashboards instance throws below error:

To reproduce

Try running validation on above build and see that it succeeds.
Exact command:

unset JAVA_HOME && ./validation.sh --file-path opensearch=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/3.0.0/10410/linux/x64/tar/dist/opensearch/opensearch-3.0.0-linux-x64.tar.gz opensearch-dashboards=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/3.0.0/8008/linux/x64/tar/dist/opensearch-dashboards/opensearch-dashboards-3.0.0-linux-x64.tar.gz

Expected behavior

Validation should fail if OSD is not coming up

Screenshots

If applicable, add screenshots to help explain your problem.

Host / Environment

No response

Additional context

No response

Relevant log output

No response

[gaiksaya]

Hi @AMoo-Miki
Do you know a better way to test if Dashboards is valid? We are only using one validation for OSD which is http://localhost:5601/api/status
https://github.com/opensearch-project/opensearch-build/blob/main/src/validation_workflow/api_test_cases.py#L36

[ashwin-pc]

How did we determine that it's a bootstrapping error?

[gaiksaya]

How did we determine that it's a bootstrapping error?

Actually it bootstraps just fine and we are able to get status code 200 for localhost:560/api/status but the home page shows above error.