#89 --- RFB gold processing

[MrSqually]

This PR is to add a process.py file for converting a directory of gold JSON annotations into a single CSV file. This satisfies the first two objectives of #89.

additions

• role-filler-binding/process.py
• gold files generated from process.py on 231117-aapb-annotations-44 data

discussion before merging

• is this a suitable format for the data (newline-separated CSV)?
• do we want to discard any of the non-RF data from this batch? do we actually want all these duplicates?

[keighrim]

• gold file(s) isn't compliant to the repository cataloging guideline (https://github.com/clamsproject/aapb-annotations?tab=readme-ov-file#gold-dataset-files) must be in golds dir, separate by asset guid. Please read through the guidelines and associated documents (conventions and templates)
• gold file is using CR LF, but we use linux format (LF only)
• the sub-project readme also needs to be updated based on the proc.py and gold format.

[keighrim]

For the second discussion point, I think we should keep the duplicate labels, since they are also human generated (valuable) data that have potential usages.

[bohJiang12]

Implementations

• process.py: Updated the script to
  • export formatted .csv files with additional column SKIPPED indicating whether a frame is skipped by the human annotator
  • store each GUID under the protocol required directory golds
  • set the .csv file as LF format (try run cat -A <csv_file> | less to see if only dollar sign $ at the end for each line)
• README.md: Added description for process.py and golds directory, especially for how the ANNOTATIONS column relates to raw annotations stored in JSON format.
• requirements.txt: created my dev environment as required by the document

[keighrim]

okay, output looks good. Just a few minor thing

• old csv gold file now can be deleted
• requirements.txt seems to be too verbose, while there's only one thrid-party library (clams-utils) used in the proc.py..?

[bohJiang12]

• requirements.txt seems to be too verbose, while there's only one thrid-party library (clams-utils) used in the proc.py..?

In fact, I just exported pip installed packages using pip freeze, this might show many packages but only clams_utils be used. So I'll update them later.

[keighrim]

@bohJiang12 I added a new column to mark the scene types on which the annotation is done. Not sure if and how adding this new column affects the evaluation counter-part (clamsproject/aapb-evaluations#66). Please take a look at this change.