Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update old format message files #183

Closed
nicolemah99 opened this issue Jul 31, 2024 · 0 comments · Fixed by #188
Closed

Update old format message files #183

nicolemah99 opened this issue Jul 31, 2024 · 0 comments · Fixed by #188
Assignees
Labels
bug Something isn't working

Comments

@nicolemah99
Copy link
Collaborator

nicolemah99 commented Jul 31, 2024

We need to update the renaming script to also update the message file format. We no longer need the path because the mqtt service is now on the DAS side and the script that reads the message should determine the path to use itself since the message is being transferred with the file. Additionally, we need to update the field names and include the md5sum of the zip file in the message.

Old message file format

{
  "id": "10009",
  "filename": "10009.zip",
  "path": "kea/events/2024-06/sel00",
  "data_type": "events"
}

Current message file format

{
  "event_id": "10009",
  "filename": "kea-events-sel00-202406-10009.zip",
  "path": "kea/events/level0/2024-06/sel00",
  "data_type": "events"
}

New message file format

{
  "event_id": "10009",
  "filename": "kea-events-sel00-202406-10009.zip",
  "md5sum": "d41d8cd98f00b204e9800998ecf8427e",
  "data_type": "events"
}

Required Updates:

  1. Remove Path Field:
    • The script that reads the message should determine the path.
  2. Field Names:
    • Change id to event_id.
    • Update filename to the new zipfile name kea-events-sel00-202406-10009.zip
  3. Add md5sum Field:
    • Include the MD5 checksum of the zip file.
@nicolemah99 nicolemah99 self-assigned this Jul 31, 2024
@nicolemah99 nicolemah99 added the bug Something isn't working label Jul 31, 2024
@nicolemah99 nicolemah99 changed the title Check path in message file Update old format message files Aug 6, 2024
@nicolemah99 nicolemah99 linked a pull request Aug 9, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant