You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What Operating System(s) are you seeing this problem on?
Linux (x86-64)
Backend.AI version
24.09
Describe the bug
While investigating why our integration tests in a GitHub Action workflow were not failing as expected,
I discovered that the ./backend.ai test run-cli command returns an exit code of 0 even when it encounters a failure.
This behavior is misleading because it causes CI/CD pipelines to treat failing tests as successful, leading to false positives.
To Reproduce
Run the ./backend.ai test run-cli admin
Check the exit code immediately after the command finishes using echo $?
Expected Behavior
The command should return a non-zero exit code if it encounters any errors during execution.
Anything else?
No response
The text was updated successfully, but these errors were encountered:
why-arong
changed the title
./backend.ai test run-cli command returns exit code 0 even on failure./backend.ai test run-cli command returns exit code 0 even on failure
Aug 7, 2024
What Operating System(s) are you seeing this problem on?
Linux (x86-64)
Backend.AI version
24.09
Describe the bug
While investigating why our integration tests in a GitHub Action workflow were not failing as expected,
I discovered that the
./backend.ai test run-cli
command returns an exit code of 0 even when it encounters a failure.This behavior is misleading because it causes CI/CD pipelines to treat failing tests as successful, leading to false positives.
To Reproduce
./backend.ai test run-cli admin
echo $?
Expected Behavior
The command should return a non-zero exit code if it encounters any errors during execution.
Anything else?
No response
The text was updated successfully, but these errors were encountered: