Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Placement of Slates Project Eval data sheet #43

Open
jarumihooi opened this issue Sep 19, 2023 · 1 comment
Open

Placement of Slates Project Eval data sheet #43

jarumihooi opened this issue Sep 19, 2023 · 1 comment

Comments

@jarumihooi
Copy link
Collaborator

Because

As related to the Slates Project, there was an evaluation of the app done by GBH on this spreadsheet in 2020 by Raananah.
It is currently unhomed.

https://docs.google.com/spreadsheets/d/1VHEpYmAtBHkIHTzbYtUexRNqALEHLi-3rwzIXtfQG-E/edit#gid=0

Done when

When this sheet is downloaded and has a place to go.

Additional context

Let's use "validation" for data validation during annotation and data quality testing.

Let's use "evaluation" for evaluating the performance of apps

@clams-bot clams-bot added this to infra Sep 19, 2023
@github-project-automation github-project-automation bot moved this to Todo in infra Sep 19, 2023
@keighrim
Copy link
Member

keighrim commented Dec 8, 2023

I think in addition to

When this sheet is downloaded and has a place to go.

We also need to document the batch information and readme file. Regarding readme;

  • For annotation process, I believe it'd be very similar to the already-documented slate annotation process.
  • For annotator demography and annotation tool, it'd be most just unknown...?
  • For formatting of "raw", I think we need to consider converting the google sheet content to match existing slate CSV raw file, so that we can re-use the proc.py.

Given all that, I think the main question is whether we want to include/release this gsheet as a public dataset...?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

2 participants