-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[TRACKER] collection test failures #1
Comments
I think you can ignore some of those collections since they'll be removed from Ansible 10 anyway:
|
BTW I see purestorage.fusion on your list. It looks like this collection will be deprecated. So maybe you can ignore this, too. |
@gotmax23 This collection has been deprecated by it's maintainers and will be removed from Ansible 10: ansible-community/ansible-build-data#374 |
Results for 10.3.0 are listed below and also represented in https://github.com/ansible-community/package-test-results/tree/main/rendered/10.3.0. Some of the duplicates from above may have been fixed in git but never released. Other have not fixed all the issues or not responded at all. (Duplicates that are already listed in the issue description and that have had issues filled already should be checked off here.)
|
@gundalow followed up with (We should follow up again in a couple weeks) |
are also a problem. The maintainer says that our results are broken and differ from the results reported by Automation Hub. Perhaps there are sanity ignore entries that are not included in the git repository. Otherwise, I am at a loss. |
@gundalow, any idea what's going on with the Cisco collections? Looking at the output in https://console.redhat.com/ansible/automation-hub/repo/published/cisco/intersight/import-log/, it seems that AH doesn't run the validate-modules test which is one that we require to pass. |
A discussion about community.network has been started in https://forum.ansible.com/t/should-we-remove-community-network-from-the-ansible-community-package/8030. |
It turned out that this is actually due to a bug in ansible-test (ansible/ansible#83842). On the other hand, if Automation Hub's sanity tests accepted it, it means that AH doesn't run the validate-modules sanity test. This basically means that successful import in AH doesn't mean that all sanity tests pass. (But it also doesn't mean that the ones not run fail...) |
10.4.0 (Duplicates that are already listed in the issue description and that have had issues filled already should be checked off here.)
Total: 25 collections |
@gotmax23 You've started and named this issue I suggest to open an new What do you think? |
I removed the version number from the issue name. The idea is — for now — to use this issue on a rolling basis to track changes for whatever the latest release is. |
(All the collections that have been retired from Ansible 10.3.0 or otherwise no longer have sanity test failures in that version should be checked off.)
15512 validate-modules
13015 validate-modules
9502 validate-modules
136 WRONG_HASH
113 yamllint
66 validate-modules
60 compile-python-3.10
60 compile-python-3.11
60 compile-python-3.12
59 compile-python-2.7
59 compile-python-3.6
59 compile-python-3.7
59 compile-python-3.8
59 compile-python-3.9
11 ansible-doc
1 WRONG_GALAXY_YML_NAME
654 BANNED_SANITY
240 validate-modules
120 WRONG_HASH
3 ansible-doc
342 validate-modules
3 ansible-doc
2 yamllint
311 validate-modules
186 validate-modules
153 yamllint
85 validate-modules
7 ansible-doc
4 yamllint
25 validate-modules
23 compile-python-2.7
24 validate-modules
3 compile-python-3.10
3 compile-python-3.11
3 compile-python-3.12
1 compile-python-2.7
25 validate-modules
9 yamllint
15 validate-modules
7 ansible-doc
1 yamllint
18 validate-modules
3 compile-python-2.7
16 validate-modules
10 validate-modules
9 validate-modules
7 validate-modules
1 WRONG_HASH
7 validate-modules
5 compile-python-2.7
2 yamllint
4 validate-modules
2 compile-python-2.7
6 compile-python-2.7
5 validate-modules
4 BANNED_SANITY
4 BANNED_SANITY
4 validate-modules
3 BANNED_SANITY
3 validate-modules
2 yamllint
1 validate-modules
3 WRONG_HASH
1 BANNED_SANITY
1 WRONG_HASH
2 validate-modules
2 yamllint
2 yamllint
2 WRONG_HASH
2 compile-python-2.7
2 validate-modules
1 compile-python-2.7
1 compile-python-2.7
1 BANNED_SANITY
1 compile-python-2.7
1 compile-python-2.7
1 validate-modules
1 compile-python-2.7
2 WRONG_HASH
1 validate-modules
The text was updated successfully, but these errors were encountered: