Refactored `validate-refs` to use new OpenSearch Serverless and registry-common library #906

al-niessner · 2024-05-23T16:18:25Z

🗒️ Summary

Use registry-common for access to opensearch via Java SDK v2

⚙️ Test Data and/or Report

Had to remove the automated RI checks that did not seem to work anyway (they were causing errors but ignored by checkers) because need a mock for registry-common ConnectionFactory and RestClient. Loaded a DB by hand using ref data repository then ran RI. It ran to completion with no unexpected errors.

♻️ Related Issues

Alters #1053
Closes #895
Closes #621
Depends on NASA-PDS/registry-common#57
depends on NASA-PDS/registry-common#89
depends on NASA-PDS/harvest#191

al-niessner · 2024-05-23T16:20:43Z

@jasonmlkang @tloubrieu-jpl

Stuck at a bug that requires validate pom include jakarta. If we are moving validate-refs to harvest (my recommendation because they share a large amount of code via config) then this would be the time to do it.

jordanpadams · 2024-05-23T21:21:18Z

@al-niessner let's maybe move forward with this adding this JAR, and then we can create a ticket down the road to refactor, as needed. I like this validate-refs being in the same package as validate because users don't want to download or care to download 2 packages to do "validation". But we can climb that tree when we get to it.

jordanpadams · 2024-05-23T21:21:44Z

@al-niessner also looks like the tests are failing here.

al-niessner · 2024-05-24T15:31:18Z

@jordanpadams

This cannot build until we update registry-common and harvest. Even if it is complete, it cannot work here or in the wild until those repos are updated. Currently, it only works in my deve environment.

jordanpadams · 2024-06-20T21:49:07Z

@al-niessner I think we have registry-common merged and some data should be in the AWS OpenSearch Serverless. Do we want to get back onto this task?

al-niessner · 2024-06-20T22:05:22Z

Sure. Still stuck with the big question of do we move reference checker to harvest since it shares the configuration or make validate artifact dependent on harvest artifact. I still suggest moving reference checker to harvest since it has zero dependencies on validate.

I understand the grouping issue. I suggest solving that with a a pseudo artifact that installs many tools in some grouping rather than actually trying to group stuff by use rather than software dependency.

Moved to using registry-common and harvest for the tools they provide. harvest provides the configuration reader while the registry-common provides the interface to any opensearch. Updated the logic to use the new tools which made the unit tests invalid. Removed all of the unit test code for RI since it is no longer applicable. The logic of RI has remained. What has changed is how the interface to opensearch is used.

jordanpadams · 2024-09-26T18:32:39Z

@al-niessner looks like this doesn't compile.

Compilation failure
[ERROR] /Users/jpadams/proj/pds/pdsen/workspace/validate/src/main/java/gov/nasa/pds/validate/ri/AuthInformation.java:[6,32] package gov.nasa.pds.harvest.cfg does not exist

al-niessner · 2024-09-26T18:35:09Z

Harvest pom?

…

On Thu, Sep 26, 2024, 11:33 Jordan Padams ***@***.***> wrote: @al-niessner <https://github.com/al-niessner> looks like this doesn't compile. Compilation failure [ERROR] /Users/jpadams/proj/pds/pdsen/workspace/validate/src/main/java/gov/nasa/pds/validate/ri/AuthInformation.java:[6,32] package gov.nasa.pds.harvest.cfg does not exist — Reply to this email directly, view it on GitHub <#906 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAIUBISS2HCKUK6VGJ6WRV3ZYRHN3AVCNFSM6AAAAABIF7N5KSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNZXGY2TSMRTHE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

al-niessner · 2024-09-26T20:25:06Z

@jordanpadams

You were not at the latest versions. Updated but now buildbot cannot find the latest versions of registry-common (2.1.0) or harvest (4.1.0). Get those out and you should be alright.

jordanpadams · 2024-09-26T22:44:28Z

@al-niessner now that I figured out how to get it to compile once we update registry-common and harvest, how do I run this? do I need to give it a harvest config? can I still give it what I gave it before (a txt file with a URL and a path to an auth file)?

jordanpadams · 2024-09-26T22:45:31Z

The --help output looks the same, but I'm not sure what I am supposed to put for some of this stuff.

usage: validate-refs LIDVID LABEL-FILEPATH MANIFEST-FILEPATH [-a
       <auth-file>] [-c <harvest-config>] [-h <arg>] [-r
       <registry-connection>] [-t <count>] [-verbose <arg>]

Checks that (1) all product references within a given product and (2) any
aggregrate product references (bundles -> collections -> products) exist
in the Registry OpenSearch DB or Search API.

Expected positional arguments are either a LIDVID, LABEL-FILEPATH, or
MANIFEST-FILEPATH.
   - A LIDVID must start with urn:.
   - A LABEL-FILEPATH must be a well formed PDS XML file.
   - A MANIFEST-FILEPATH is one item per line with an item being a lidvid
or label. Each line must be terminated by a LF.

Multiple arguments may be given in any order, for example:
   > validate-refs urn:nasa:pds:foo::1.0 label.xml urn:nasa:pds:bar::2.0
manifest.txt

 -a,--auth-opensearch <auth-file>                 file with the credential
                                                  content to have full,
                                                  direct read-only access
                                                  to the Registry
                                                  OpenSearch DB
 -c,--harvest-config <harvest-config>             file used by harvest to
                                                  ingest data that
                                                  contains the appropriate
                                                  authorization and
                                                  registry connection
                                                  information
 -h,--help <arg>                                  show this text and exit
 -r,--registry-connection <registry-connection>   URL point to the
                                                  registry connection
                                                  information usually of
                                                  the form
                                                  app://connection/direct/
                                                  localhost.xml
 -t,--threads <count>                             process the lidvids in
                                                  parallel (multiple
                                                  threads) with this
                                                  argument being the
                                                  maximum number of
                                                  threads
 -verbose,--verbose <arg>                         set logging level to
                                                  INFO

An auth-file is a text file of the Java property format with two
variables, 'user' and 'password' for example:
      user=janedoe
      password=mypassword

Both -a and -r are required with using them and are mutually exclusive
with -c

User must now supply the conneciton URL and auth file.

al-niessner · 2024-10-09T16:28:55Z

@jordanpadams

Should work with -a and -r now. I cleaned up the CLI help too. Yanked dependency on harvest from POM. Good luck.

al-niessner · 2024-10-24T21:16:36Z

@jordanpadams

Still not stable. I do not understand this at all; meaning, it is more fun than usual because it is so challenging.

I am doing this locally mvn package test but it does not do the summary at the end so I cannot tell what really failed and what was supposed to fail. How do I get the summary like in the github actions window?

jordanpadams · 2024-10-24T21:25:13Z

@al-niessner I think it is just mvn clean test (mvn package runs the tests already)

…s in cucumber result message

al-niessner · 2024-10-31T17:28:19Z

@jordanpadams

It is ready for your testing again. I have no idea what secret it thinks we have revealed, but cannot believe there is anything really there.

nutjob4life

Looks good:

[WARNING] Tests run: 260, Failures: 0, Errors: 0, Skipped: 23
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  09:12 min
[INFO] Finished at: 2024-10-31T13:18:40-05:00
[INFO] ------------------------------------------------------------------------

jordanpadams · 2024-10-31T21:01:43Z

@al-niessner I will update this secrets baseline, but here are the instructions for recreating and auditing the secrets baseline.

nutjob4life · 2024-10-31T21:22:53Z

FYI, the instructions are here: https://github.com/NASA-PDS/nasa-pds.github.io/wiki/Git-and-Github-Guide#detect-secrets

al-niessner · 2024-10-31T22:31:51Z

@jordanpadams @nutjob4life

Thanks for the link. I clicked on the one in the actions console and it gave me a 404.

jordanpadams

@al-niessner a few issues arose when trying to test this:

As a very novice user, I'm not sure what this value is supposed to be:

 -r,--registry-connection <registry-connection>   URL point to the
                                                  registry connection
                                                  information usually of
                                                  the form
                                                  app://connection/direct/
                                                  localhost.xml

Is this the AOSS URL? Does it need to contain the path to the specific registry/registries that I want to query again? Is there any way we can default this to our production registry URL, and the end user could just overwrite if they are testing or want to use something else?

When I gave it what I thought I was supposed to put there, I get an unhandled exception:

12:09:13.232 [main] FATAL gov.nasa.pds.validate.ri.OpensearchDocument - Error reading from URL: uninitialized connection factory
jakarta.xml.bind.UnmarshalException: null
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:221) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:189) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:146) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:151) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:161) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at gov.nasa.pds.registry.common.connection.RegistryConnectionContent.from(RegistryConnectionContent.java:26) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.registry.common.EstablishConnectionFactory.from(EstablishConnectionFactory.java:19) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.registry.common.EstablishConnectionFactory.from(EstablishConnectionFactory.java:15) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.validate.ri.AuthInformation.getConnectionFactory(AuthInformation.java:30) ~[validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.OpensearchDocument.load(OpensearchDocument.java:25) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.OpensearchDocument.exists(OpensearchDocument.java:81) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.Cylinder.run(Cylinder.java:40) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.Engine.processQueueUntilEmpty(Engine.java:69) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.CommandLineInterface.process(CommandLineInterface.java:120) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ReferenceIntegrityMain.main(ReferenceIntegrityMain.java:14) [validate-3.6.0-SNAPSHOT.jar:?]
Caused by: java.io.FileNotFoundException: https://b3rqys09xmx9i19yn64i.us-west-2.aoss.amazonaws.com
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:2032) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1625) ~[?:?]
	at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:224) ~[?:?]
	at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown Source) ~[xercesImpl-2.12.2.jar:2.12.2]
	at org.apache.xerces.impl.XMLVersionDetector.determineDocVersion(Unknown Source) ~[xercesImpl-2.12.2.jar:2.12.2]
	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:218) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	... 14 more
12:09:13.237 [main] ERROR Reference Integrity - The given lidvid 'urn:jaxa:darts:hyb2::2.0' is missing from the database.
12:09:13.349 [Thread-0] ERROR gov.nasa.pds.validate.ri.CommandLineInterface - Had an error communicating with opensearch
jakarta.xml.bind.UnmarshalException: null
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:221) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:189) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:146) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:151) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:161) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at gov.nasa.pds.registry.common.connection.RegistryConnectionContent.from(RegistryConnectionContent.java:26) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.registry.common.EstablishConnectionFactory.from(EstablishConnectionFactory.java:19) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.registry.common.EstablishConnectionFactory.from(EstablishConnectionFactory.java:15) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.validate.ri.AuthInformation.getConnectionFactory(AuthInformation.java:30) ~[validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.DuplicateFileAreaFilenames.findDuplicates(DuplicateFileAreaFilenames.java:44) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.DuplicateFileAreaFilenames.run(DuplicateFileAreaFilenames.java:36) [validate-3.6.0-SNAPSHOT.jar:?]
	at java.base/java.lang.Thread.run(Thread.java:840) [?:?]
Caused by: java.io.FileNotFoundException: https://b3rqys09xmx9i19yn64i.us-west-2.aoss.amazonaws.com
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:2032) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1625) ~[?:?]
	at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:224) ~[?:?]
	at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown Source) ~[xercesImpl-2.12.2.jar:2.12.2]
	at org.apache.xerces.impl.XMLVersionDetector.determineDocVersion(Unknown Source) ~[xercesImpl-2.12.2.jar:2.12.2]
	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:218) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	... 11 more
12:09:13.554 [main] FATAL gov.nasa.pds.validate.ri.OpensearchDocument - Error reading from URL: uninitialized connection factory
jakarta.xml.bind.UnmarshalException: null
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:221) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:189) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:146) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:151) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at jakarta.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:161) ~[jakarta.xml.bind-api-4.0.1.jar:4.0.1]
	at gov.nasa.pds.registry.common.connection.RegistryConnectionContent.from(RegistryConnectionContent.java:26) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.registry.common.EstablishConnectionFactory.from(EstablishConnectionFactory.java:19) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.registry.common.EstablishConnectionFactory.from(EstablishConnectionFactory.java:15) ~[registry-common-2.1.0-20241024.032014-5.jar:?]
	at gov.nasa.pds.validate.ri.AuthInformation.getConnectionFactory(AuthInformation.java:30) ~[validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.OpensearchDocument.load(OpensearchDocument.java:25) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.OpensearchDocument.exists(OpensearchDocument.java:81) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.Cylinder.has_children(Cylinder.java:23) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.Cylinder.run(Cylinder.java:55) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.Engine.processQueueUntilEmpty(Engine.java:69) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ri.CommandLineInterface.process(CommandLineInterface.java:120) [validate-3.6.0-SNAPSHOT.jar:?]
	at gov.nasa.pds.validate.ReferenceIntegrityMain.main(ReferenceIntegrityMain.java:14) [validate-3.6.0-SNAPSHOT.jar:?]
Caused by: java.io.FileNotFoundException: https://b3rqys09xmx9i19yn64i.us-west-2.aoss.amazonaws.com
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:2032) ~[?:?]
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1625) ~[?:?]
	at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:224) ~[?:?]
	at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown Source) ~[xercesImpl-2.12.2.jar:2.12.2]
	at org.apache.xerces.impl.XMLVersionDetector.determineDocVersion(Unknown Source) ~[xercesImpl-2.12.2.jar:2.12.2]
	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) ~[xercesImpl-2.12.2.jar:?]
	at org.glassfish.jaxb.runtime.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:218) ~[jaxb-runtime-4.0.2.jar:4.0.2 - d104f19]
	... 15 more

al-niessner · 2024-11-01T19:32:14Z

@jordanpadams

Would it help to say, "The value, not any of the attributes, of <registry> in your harvest config file."? If you did not supply that value, then you will bet that wonderful XML parsing error.

jordanpadams · 2024-11-01T19:57:48Z

@al-niessner copy that. could we use the same config registry-mgr uses instead? From @tloubrieu-jpl instructions here, this looks like some XML config file, which makes sense since it really needs to be run with Cognito in the loop in order to authorize access, no?

al-niessner · 2024-11-01T20:27:17Z

@jordanpadams

The value of <registry> is the same as registry-mgr. Reducing to that saved us dependency problems with harvest. I had originally embedded them into registry-common using app:// but @tloubrieu-jpl moved them to files that the user must maintain. Albeit, using external files is supported even in the original implementation; meaning, he exercised an option not took a different path.

Now that you know how it is all tied together, what words would be helpful in the help?

jordanpadams · 2024-11-05T17:21:04Z

@al-niessner right. I think I am using the right URL for one of our registries, and it is not working. Were you able to successfully test with a dev or production registry?

al-niessner · 2024-11-05T17:24:18Z

@jordanpadams

Can you post or email me your command line? I will see if I can figure out what is wrong.

tloubrieu-jpl · 2024-11-12T21:41:11Z

The solution is not complete because it does not check for the products in all the nodes registry.

al-niessner · 2024-11-12T22:58:29Z

@tloubrieu-jpl

Do we not have an index that maps to all of the indices? Would we prefer "index_a,index_b,index_c" or "index_a;index_b;index_c" or either?

jordanpadams · 2024-11-21T20:34:02Z

@al-niessner The problem here is the current AOSS auth layer does not support this. I may be able to test this with an admin user, but a regular node user would not be able to do this without a change to that layer. blocked by NASA-PDS/registry#348

refactored for Java SDK v2

29e3d3c

al-niessner requested a review from a team as a code owner May 23, 2024 16:18

al-niessner marked this pull request as draft May 23, 2024 16:18

al-niessner self-assigned this May 23, 2024

Al Niessner added 3 commits August 6, 2024 09:37

Merge branch 'main' of github.com:NASA-PDS/validate into issue_895

d5f91ee

testing cleanup

24648dc

al-niessner marked this pull request as ready for review August 8, 2024 15:49

al-niessner mentioned this pull request Aug 8, 2024

Bump org.opensearch.client:opensearch-rest-high-level-client from 2.5.0 to 2.15.0 #947

Closed

jordanpadams changed the title ~~895: refactored for Java SDK v2~~ Refactored validate-refs to use new OpenSearch Serverless and registry-common Aug 9, 2024

jordanpadams changed the title ~~Refactored validate-refs to use new OpenSearch Serverless and registry-common~~ Refactored validate-refs to use new OpenSearch Serverless and registry-common library Aug 9, 2024

Merge branch 'main' into issue_895

2270c77

al-niessner mentioned this pull request Aug 19, 2024

Bump org.opensearch.client:opensearch-rest-high-level-client from 2.5.0 to 2.16.0 #971

Closed

update to latest versions

ace6d53

jordanpadams and others added 2 commits September 26, 2024 20:44

Update to reference refactored configmanager

bf9394b

remove harvest config

8d5b86b

User must now supply the conneciton URL and auth file.

al-niessner mentioned this pull request Oct 9, 2024

Bump org.opensearch.client:opensearch-rest-client from 2.16.0 to 2.17.1 #1022

Closed

Merge branch 'main' into issue_895

1fe093a

jordanpadams and others added 2 commits October 18, 2024 18:30

Merge branch 'main' into issue_895

8ec5791

Merge branch 'main' of github.com:NASA-PDS/validate into issue_895

734cd18

Al Niessner added 3 commits October 30, 2024 12:50

fix long annoying problem of expected and found counts being backward…

86c1ef2

…s in cucumber result message

Merge branch 'main' of github.com:NASA-PDS/validate into issue_895

a76a662

Merge branch 'main' of github.com:NASA-PDS/validate into issue_895

bd32d75

nutjob4life approved these changes Oct 31, 2024

View reviewed changes

Update secrets.baseline

8f82c7a

jordanpadams requested changes Nov 1, 2024

View reviewed changes

jordanpadams self-assigned this Nov 5, 2024

jordanpadams added the sprint-backlog label Nov 5, 2024

Merge branch 'main' into issue_895

be4d470

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Refactored `validate-refs` to use new OpenSearch Serverless and registry-common library #906

Refactored `validate-refs` to use new OpenSearch Serverless and registry-common library #906

al-niessner commented May 23, 2024 •

edited

Loading

al-niessner commented May 23, 2024

jordanpadams commented May 23, 2024

jordanpadams commented May 23, 2024

al-niessner commented May 24, 2024

jordanpadams commented Jun 20, 2024

al-niessner commented Jun 20, 2024

jordanpadams commented Sep 26, 2024

al-niessner commented Sep 26, 2024 via email

al-niessner commented Sep 26, 2024

jordanpadams commented Sep 26, 2024

jordanpadams commented Sep 26, 2024

al-niessner commented Oct 9, 2024

al-niessner commented Oct 24, 2024 •

edited by jordanpadams

Loading

jordanpadams commented Oct 24, 2024

al-niessner commented Oct 31, 2024

nutjob4life left a comment

jordanpadams commented Oct 31, 2024

nutjob4life commented Oct 31, 2024

al-niessner commented Oct 31, 2024

jordanpadams left a comment •

edited

Loading

al-niessner commented Nov 1, 2024

jordanpadams commented Nov 1, 2024

al-niessner commented Nov 1, 2024

jordanpadams commented Nov 5, 2024

al-niessner commented Nov 5, 2024

tloubrieu-jpl commented Nov 12, 2024

al-niessner commented Nov 12, 2024

jordanpadams commented Nov 21, 2024

Refactored validate-refs to use new OpenSearch Serverless and registry-common library #906

Are you sure you want to change the base?

Refactored validate-refs to use new OpenSearch Serverless and registry-common library #906

Conversation

al-niessner commented May 23, 2024 • edited Loading

🗒️ Summary

⚙️ Test Data and/or Report

♻️ Related Issues

al-niessner commented May 23, 2024

jordanpadams commented May 23, 2024

jordanpadams commented May 23, 2024

al-niessner commented May 24, 2024

jordanpadams commented Jun 20, 2024

al-niessner commented Jun 20, 2024

jordanpadams commented Sep 26, 2024

al-niessner commented Sep 26, 2024 via email

al-niessner commented Sep 26, 2024

jordanpadams commented Sep 26, 2024

jordanpadams commented Sep 26, 2024

al-niessner commented Oct 9, 2024

al-niessner commented Oct 24, 2024 • edited by jordanpadams Loading

jordanpadams commented Oct 24, 2024

al-niessner commented Oct 31, 2024

nutjob4life left a comment

Choose a reason for hiding this comment

jordanpadams commented Oct 31, 2024

nutjob4life commented Oct 31, 2024

al-niessner commented Oct 31, 2024

jordanpadams left a comment • edited Loading

Choose a reason for hiding this comment

al-niessner commented Nov 1, 2024

jordanpadams commented Nov 1, 2024

al-niessner commented Nov 1, 2024

jordanpadams commented Nov 5, 2024

al-niessner commented Nov 5, 2024

tloubrieu-jpl commented Nov 12, 2024

al-niessner commented Nov 12, 2024

jordanpadams commented Nov 21, 2024

Refactored `validate-refs` to use new OpenSearch Serverless and registry-common library #906

Refactored `validate-refs` to use new OpenSearch Serverless and registry-common library #906

al-niessner commented May 23, 2024 •

edited

Loading

al-niessner commented Oct 24, 2024 •

edited by jordanpadams

Loading

jordanpadams left a comment •

edited

Loading