Skip to content
This repository has been archived by the owner on Sep 1, 2024. It is now read-only.

Metrics collection - Error rate #60

Open
2 tasks
litalmason opened this issue Dec 24, 2023 · 0 comments
Open
2 tasks

Metrics collection - Error rate #60

litalmason opened this issue Dec 24, 2023 · 0 comments
Assignees
Labels
feature New feature
Milestone

Comments

@litalmason
Copy link
Collaborator

litalmason commented Dec 24, 2023

Description

Implement "error rate" metric. Each experiment must log the number of runs that failed.

Acceptance Criteria

  1. Log number of runs that failed for each test run (every experiment, or test suite, contains one or more test runs. each test run include a combination of algorithm, number of iterations and message size)
  2. Calculate the error rate from the number of failed run out of the total number of iterations for a specific test run

Tasks

Be the first to suggest how to break this feature into individual tasks

  • Task 1
  • Task 2
@litalmason litalmason added the feature New feature label Dec 24, 2023
@litalmason litalmason added this to the 1.2.0 milestone Dec 24, 2023
@nganani nganani self-assigned this Jan 3, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature New feature
Projects
Status: No status
Development

No branches or pull requests

2 participants