Merge pull request #837 from hyperledger/aath-summary-results

Changes by create-pull-request action
openwallet-foundation · Jun 26, 2024 · 5f84e7e · 5f84e7e
2 parents 3b8a0e8 + a34335a
commit 5f84e7e
Show file tree

Hide file tree

Showing 4 changed files with 26 additions and 351 deletions.
diff --git a/docs/README.md b/docs/README.md
@@ -14,31 +14,25 @@ that page are links to a full history of the test runs and full details on every
 The following test agents are currently supported:
 
 - [Aries Cloud Agent Python](https://github.com/hyperledger/aries-cloudagent-python) (ACA-Py)
-- [Aries Framework Go](https://github.com/hyperledger/aries-framework-go) (AF-Go)
 - [Aries Framework JavaScript](https://github.com/hyperledger/aries-framework-javascript) (AFJ)
-- [Aries Framework .NET](https://github.com/hyperledger/aries-framework-dotnet) (AF-.NET)
-- [Findy Agent](https://github.com/findy-network/findy-agent) (Findy)
 - [AriesVCX](https://github.com/hyperledger/aries-vcx) (VCX)
 
 Want to add your Aries component to this page? You need to add a runset to the
 [Aries Agent Test Harness](https://github.com/hyperledger/aries-agent-test-harness).
 
 ## Latest Interoperability Results
 
-| Test Agent | Scope | Exceptions | ACA-Py | AF-Go | AFJ | AF-.NET | Findy | VCX | **All Tests** |
-| ----- | ----- | ----- | :----: | :----: | :----: | :----: | :----: | :----: | :----: |
-| [ACA-Py](acapy.md)| AIP 1, 2 | None | 96 / 96<br>100% | 0 / 31<br>0% | 55 / 79<br>69% | 6 / 36<br>16% | 34 / 34<br>100% | 37 / 38<br>97% | **222 / 302<br>73%** |
-| [AF-Go](afgo.md)| AIP 2 | None | 0 / 31<br>0% | 26 / 45<br>57% | 0 / 0<br>0% | 0 / 0<br>0% | 0 / 0<br>0% | 0 / 0<br>0% | **26 / 76<br>34%** |
-| [AFJ](javascript.md)| AIP 1 | Revocation | 55 / 79<br>69% | 0 / 0<br>0% | 12 / 28<br>42% | 12 / 53<br>22% | 25 / 51<br>49% | 3 / 18<br>16% | **95 / 200<br>47%** |
-| [AF-.NET](dotnet.md)| AIP 1 | Proof Proposal | 6 / 36<br>16% | 0 / 0<br>0% | 12 / 53<br>22% | 0 / 12<br>0% | 6 / 39<br>15% | 0 / 0<br>0% | **12 / 111<br>10%** |
-| [Findy](findy.md)| AIP 1 | Credential Exchange | 34 / 34<br>100% | 0 / 0<br>0% | 25 / 51<br>49% | 6 / 39<br>15% | 17 / 17<br>100% | 0 / 0<br>0% | **76 / 124<br>61%** |
-| [VCX](aries-vcx.md)| AIP 1 | Revocation | 37 / 38<br>97% | 0 / 0<br>0% | 3 / 18<br>16% | 0 / 0<br>0% | 0 / 0<br>0% | 19 / 20<br>95% | **59 / 76<br>77%** |
+| Test Agent | Scope | Exceptions | ACA-Py | AFJ | VCX | **All Tests** |
+| ----- | ----- | ----- | :----: | :----: | :----: | :----: |
+| [ACA-Py](acapy.md)| AIP 1, 2 | None | 95 / 96<br>98% | 19 / 67<br>28% | 37 / 38<br>97% | **151 / 201<br>75%** |
+| [AFJ](javascript.md)| AIP 1 | Revocation | 19 / 67<br>28% | 12 / 28<br>42% | 3 / 18<br>16% | **34 / 113<br>30%** |
+| [VCX](aries-vcx.md)| AIP 1 | Revocation | 37 / 38<br>97% | 3 / 18<br>16% | 18 / 20<br>90% | **58 / 76<br>76%** |
 
 - Where the row and column are the same Test Agent, the results include only the tests where the Test Agent plays ALL of the roles (ACME, Bob, Faber and Mallory)
 - The results in the "All Tests" column include tests involving the "Test Agent" in ANY of the roles.
 - Wondering what the results mean? Please read the brief [introduction to Aries interoperability](aries-interop-intro.md) for some background.
 - Select the "Test Agent" links to drill down into the tests being run for each Test Agent.
 
 
-*Results last updated: Sun Jun 16 19:32:41 UTC 2024*
+*Results last updated: Wed Jun 26 05:18:21 UTC 2024*
 
diff --git a/docs/acapy.md b/docs/acapy.md
@@ -4,54 +4,24 @@
 
 | Runset | ACME<br>(Issuer) | Bob<br>(Holder) | Faber<br>(Verifier) | Mallory<br>(Holder) | Scope | Results | 
 | ------ | :--------------: | :-------------: | :----------------: | :-----------------: | ----- | :-----: | 
-| [acapy-afgo](#runset-acapy-afgo) | acapy-main<br>0.12.1 | afgo-interop<br>unknown | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | pre-AIP 2.0 | [**0 / 14<br>0%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-afgo/reports/latest/index.html?redirect=false#behaviors) |
-| [acapy-afj](#runset-acapy-afj) | acapy-main<br>0.12.1 | javascript<br>0.5.0-alpha.97 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**38 / 39<br>97%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-javascript/reports/latest/index.html?redirect=false#behaviors) |
-| [acapy-aip10](#runset-acapy-aip10) | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**35 / 35<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-aip10/reports/latest/index.html?redirect=false#behaviors) |
+| [acapy-afj](#runset-acapy-afj) | acapy-main<br>0.12.1 | javascript<br>0.5.0-alpha.97 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**8 / 39<br>20%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-javascript/reports/latest/index.html?redirect=false#behaviors) |
+| [acapy-aip10](#runset-acapy-aip10) | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**34 / 35<br>97%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-aip10/reports/latest/index.html?redirect=false#behaviors) |
 | [acapy-aip20](#runset-acapy-aip20) | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 2.0 | [**61 / 61<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-aip20/reports/latest/index.html?redirect=false#behaviors) |
 | [acapy-ariesvcx](#runset-acapy-ariesvcx) | acapy-main<br>0.12.1 | aries-vcx<br>1.0.0 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**18 / 18<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
-| [acapy-dotnet-javascript](#runset-acapy-dotnet-javascript) | acapy-main<br>0.12.1 | javascript<br>0.5.0-alpha.97 | dotnet<br> | acapy-main<br>0.12.1 | AIP 1.0 | [**6 / 12<br>50%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-javascript-f-dotnet/reports/latest/index.html?redirect=false#behaviors) |
-| [acapy-dotnet](#runset-acapy-dotnet) | acapy-main<br>0.12.1 | dotnet<br> | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**0 / 12<br>0%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-dotnet/reports/latest/index.html?redirect=false#behaviors) |
-| [acapy-findy](#runset-acapy-findy) | acapy-main<br>0.12.1 | findy<br>0.31.67 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**17 / 17<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-findy/reports/latest/index.html?redirect=false#behaviors) |
-| [afgo-acapy](#runset-afgo-acapy) | afgo-interop<br>unknown | acapy-main<br>0.12.1 | afgo-interop<br>unknown | afgo-interop<br>unknown | pre-AIP 2.0 | [**0 / 17<br>0%**](https://allure.vonx.io/api/allure-docker-service/projects/afgo-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
 | [afj-acapy](#runset-afj-acapy) | javascript<br>0.5.0-alpha.97 | acapy-main<br>0.12.1 | javascript<br>0.5.0-alpha.97 | javascript<br>0.5.0-alpha.97 | AIP 1.0 | [**11 / 28<br>39%**](https://allure.vonx.io/api/allure-docker-service/projects/javascript-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
 | [ariesvcx-acapy](#runset-ariesvcx-acapy) | aries-vcx<br>1.0.0 | acapy-main<br>0.12.1 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | AIP 1.0 | [**19 / 20<br>95%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
-| [dotnet-acapy](#runset-dotnet-acapy) | dotnet<br> | acapy-main<br>0.12.1 | dotnet<br> | dotnet<br> | AIP 1.0 | [**0 / 12<br>0%**](https://allure.vonx.io/api/allure-docker-service/projects/dotnet-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
-| [findy-acapy](#runset-findy-acapy) | findy<br>0.31.67 | acapy-main<br>0.12.1 | findy<br>0.31.67 | findy<br>0.31.67 | AIP 1.0 | [**17 / 17<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/findy-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
 
 ## Runset Notes
 
-### Runset **acapy-afgo**
-
-Runset Name: ACA-PY to AF-Go
-
-```tip
-**Latest results: 0 out of 14 (0%)**
-
-
-*Last run: Sat Jun 15 16:12:36 UTC 2024*
-```
-
-#### Current Runset Status
-
-All of the tests being executed in this runset are passing.
-
-*Status Note Updated: 2021.09.27*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-afgo/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/acapy-b-afgo/reports/latest)
-
-
 ### Runset **acapy-afj**
 
 Runset Name: ACA-PY to AFJ
 
 ```tip
-**Latest results: 38 out of 39 (97%)**
+**Latest results: 8 out of 39 (20%)**
 
 
-*Last run: Sat Jun 15 16:43:11 UTC 2024*
+*Last run: Wed Jun 26 00:29:18 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -71,10 +41,10 @@ Most of the tests are running. The tests not passing are being investigated.
 Runset Name: ACA-PY to ACA-Py
 
 ```tip
-**Latest results: 35 out of 35 (100%)**
+**Latest results: 34 out of 35 (97%)**
 
 
-*Last run: Sat Jun 15 11:58:46 UTC 2024*
+*Last run: Wed Jun 26 00:52:36 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -97,7 +67,7 @@ Runset Name: ACA-PY to ACA-Py
 **Latest results: 61 out of 61 (100%)**
 
 
-*Last run: Sat Jun 15 12:52:30 UTC 2024*
+*Last run: Wed Jun 26 01:25:18 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -120,7 +90,7 @@ Runset Name: acapy to aries-vcx
 **Latest results: 18 out of 18 (100%)**
 
 
-*Last run: Sat Jun 15 17:47:06 UTC 2024*
+*Last run: Wed Jun 26 01:58:08 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -134,102 +104,6 @@ No test status note is available for this runset. Please update: .github/workflo
 - [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/acapy-b-aries-vcx/reports/latest)
 
 
-### Runset **acapy-dotnet-javascript**
-
-Runset Name: ACA-PY to AF-.NET to AFJ
-
-```tip
-**Latest results: 6 out of 12 (50%)**
-
-
-*Last run: Sat Jun 15 18:00:00 UTC 2024*
-```
-
-#### Current Runset Status
-
-All tests are working, except for three tests that include Faber in the test run as an issuer.
-These tests are; T001-RFC0037@1.2, T001.2-RFC0037@1.2, T001.4-RFC0037@1.1 . Further investigation 
-is required to determine the issue in these three tests.
-
-*Status Note Updated: 2021.03.18*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-javascript-f-dotnet/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/acapy-b-javascript-f-dotnet/reports/latest)
-
-
-### Runset **acapy-dotnet**
-
-Runset Name: ACA-PY to AF-.NET
-
-```tip
-**Latest results: 0 out of 12 (0%)**
-
-
-*Last run: Sat Jun 15 18:06:15 UTC 2024*
-```
-
-#### Current Runset Status
-
-The majority of tests are running and passing. T013-HIPE0011 is failing due to the Aries Framework Dotnet not supporting
-presentations containing a non-revocation interval, with a non-revocable credential. This issue is being tracked in 
-https://github.com/hyperledger/aries-framework-dotnet/issues/184
-
-*Status Note Updated: 2021.04.08*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-dotnet/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/acapy-b-dotnet/reports/latest)
-
-
-### Runset **acapy-findy**
-
-Runset Name: ACA-PY to findy
-
-```tip
-**Latest results: 17 out of 17 (100%)**
-
-
-*Last run: Sun Jun 16 06:10:24 UTC 2024*
-```
-
-#### Current Runset Status
-
-All of the tests being executed in this runset are passing.
-
-*Status Note Updated: 2021.09.14*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-findy/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/acapy-b-findy/reports/latest)
-
-
-### Runset **afgo-acapy**
-
-Runset Name: AF-Go to ACA-PY
-
-```tip
-**Latest results: 0 out of 17 (0%)**
-
-
-*Last run: Sat Jun 15 18:49:21 UTC 2024*
-```
-
-#### Current Runset Status
-
-All of the tests being executed in this runset are passing.
-
-*Status Note Updated: 2021.09.27*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/afgo-b-acapy/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/afgo-b-acapy/reports/latest)
-
-
 ### Runset **afj-acapy**
 
 Runset Name: AFJ to ACA-PY
@@ -238,7 +112,7 @@ Runset Name: AFJ to ACA-PY
 **Latest results: 11 out of 28 (39%)**
 
 
-*Last run: Sun Jun 16 17:38:12 UTC 2024*
+*Last run: Wed Jun 26 02:55:37 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -261,7 +135,7 @@ Runset Name: aries-vcx to acapy
 **Latest results: 19 out of 20 (95%)**
 
 
-*Last run: Sun Jun 16 16:32:03 UTC 2024*
+*Last run: Wed Jun 26 03:46:36 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -274,51 +148,5 @@ No test status note is available for this runset. Please update: .github/workflo
 - [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors)
 - [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/aries-vcx-b-acapy/reports/latest)
 
-
-### Runset **dotnet-acapy**
-
-Runset Name: AF-.NET to ACA-PY
-
-```tip
-**Latest results: 0 out of 12 (0%)**
-
-
-*Last run: Sat Jun 15 01:20:32 UTC 2024*
-```
-
-#### Current Runset Status
-
-More tests are failing than are passing when Aries Framework .NET is playing the issuer role. More investigation is needed.
-
-*Status Note Updated: 2021.03.17*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/dotnet-b-acapy/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/dotnet-b-acapy/reports/latest)
-
-
-### Runset **findy-acapy**
-
-Runset Name: findy to ACA-PY
-
-```tip
-**Latest results: 17 out of 17 (100%)**
-
-
-*Last run: Sat Jun 15 01:45:55 UTC 2024*
-```
-
-#### Current Runset Status
-
-All of the tests being executed in this runset are passing.
-
-*Status Note Updated: 2021.09.14*
-
-#### Runset Details
-
-- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/findy-b-acapy/reports/latest/index.html?redirect=false#behaviors)
-- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/findy-b-acapy/reports/latest)
-
 Jump back to the [interoperability summary](./README.md).
 
diff --git a/docs/aries-vcx.md b/docs/aries-vcx.md
@@ -6,7 +6,7 @@
 | ------ | :--------------: | :-------------: | :----------------: | :-----------------: | ----- | :-----: | 
 | [acapy-ariesvcx](#runset-acapy-ariesvcx) | acapy-main<br>0.12.1 | aries-vcx<br>1.0.0 | acapy-main<br>0.12.1 | acapy-main<br>0.12.1 | AIP 1.0 | [**18 / 18<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
 | [ariesvcx-acapy](#runset-ariesvcx-acapy) | aries-vcx<br>1.0.0 | acapy-main<br>0.12.1 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | AIP 1.0 | [**19 / 20<br>95%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
-| [ariesvcx-ariesvcx](#runset-ariesvcx-ariesvcx) | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | AIP 1.0 | [**19 / 20<br>95%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
+| [ariesvcx-ariesvcx](#runset-ariesvcx-ariesvcx) | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | AIP 1.0 | [**18 / 20<br>90%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
 | [javascript-ariesvcx](#runset-javascript-ariesvcx) | javascript<br>0.5.0-alpha.97 | aries-vcx<br>1.0.0 | javascript<br>0.5.0-alpha.97 | javascript<br>0.5.0-alpha.97 | AIP 1.0 | [**3 / 18<br>16%**](https://allure.vonx.io/api/allure-docker-service/projects/javascript-b-aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
 
 ## Runset Notes
@@ -19,7 +19,7 @@ Runset Name: acapy to aries-vcx
 **Latest results: 18 out of 18 (100%)**
 
 
-*Last run: Sat Jun 15 17:47:06 UTC 2024*
+*Last run: Wed Jun 26 01:58:08 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -41,7 +41,7 @@ Runset Name: aries-vcx to acapy
 **Latest results: 19 out of 20 (95%)**
 
 
-*Last run: Sun Jun 16 16:32:03 UTC 2024*
+*Last run: Wed Jun 26 03:46:36 UTC 2024*
 ```
 
 #### Current Runset Status
@@ -60,10 +60,10 @@ No test status note is available for this runset. Please update: .github/workflo
 Runset Name: aries-vcx to aries-vcx
 
 ```tip
-**Latest results: 19 out of 20 (95%)**
+**Latest results: 18 out of 20 (90%)**
 
 
-*Last run: Sat Jun 15 01:39:13 UTC 2024*
+*Last run: Wed Jun 26 04:17:27 UTC 2024*
 ```
 
 #### Current Runset Status