Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fermi #199

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Fermi #199

wants to merge 3 commits into from

Conversation

shb46
Copy link
Contributor

@shb46 shb46 commented Sep 20, 2024

Fermi GBM Schema for a single schema, "ALERT" - Initial Version

@shb46 shb46 marked this pull request as draft September 25, 2024 14:56
@shb46 shb46 self-assigned this Sep 25, 2024
@shb46 shb46 requested a review from jracusin October 1, 2024 00:56
},
"hitl": {
"type": "boolean",
"description": "Human in the loop"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please describe properly, not understandable for user?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Vidushi-GitHub: Please review the updated "description".

"type": "string",
"description": "Date and time of notice creation [UTC, ISO 8601], ex YYYY-MM-DDTHH:MM:SS.ssssssZ"
},
"alert_tense": {
Copy link
Member

@Vidushi-GitHub Vidushi-GitHub Oct 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's already present in core schema, you just have to ref the schema.
Same for most of the properties below, rate_snr, trigger_time etc.

@Vidushi-GitHub
Copy link
Member

We have planned a mission page, where you can keep the content present at readme file.

@Vidushi-GitHub
Copy link
Member

Hi @shb46, sorry for the delayed response due to travel and vacation. Most of the stuff looks fine.
My main confusion about schema is why strict schema there and why you are re-writing core properties, instead of ref?

@shb46
Copy link
Contributor Author

shb46 commented Oct 2, 2024

Hi @Vidushi-GitHub,

Hope everything is well! Here are my replies:

We have planned a mission page, where you can keep the content present at readme file.

  • Can we have an instrument page as well? the lat and the GBM instruments are run by separate teams.
  • Can notice type have its own page?

Hi @shb46, sorry for the delayed response due to travel and vacation. Most of the stuff looks fine. My main confusion about schema is why strict schema there and why you are re-writing core properties, instead of ref?

Those are two independent schemas intended to describe the same notice type:

  • The "Kafka" one: fermi/gbm/FermiGBMAlert.schema.json

    • Makes $ref-s to the core schema.
    • Doesn't $ref the strict schema.
    • Validates new notices received by the Kafka server.
    • More permissive compared to the strict schema.
  • The "strict" schema: fermi/gbm/strict/FermiGBMAlert.schema.json:

    • Doesn't $ref the core schema, nor the "Kafka" schema.
    • Is less permissive than the Kafka schema.
    • Clarifies what to expect in a notice, incl. which core fields are not used.
    • Used by the producer, in addition to the Kafka schema.

[Edit:] I should rename the strict schema file so it has a different name.

@Vidushi-GitHub
Copy link
Member

Hi Boyan,
Could you please change the filename?
fermi/gcn/notices/fermi/gbm/FermiGBMAlert.schema.json to fermi/gcn/notices/fermi/gbm/alert.schema.json?

As it's already in fermi/gbm folder, again fermiGBM is redundant.

@Vidushi-GitHub
Copy link
Member

We have planned a mission page, where you can keep the content present at readme file.

  • Can we have an instrument page as well? the lat and the GBM instruments are run by separate teams.
  • Can notice type have its own page?

For Fermi mission page, we have information for GCN Classic Notices at https://gcn.nasa.gov/missions/fermi, and would move forward with updating it.
@jracusin shall we separate out GBM, LAT content into two mission pages as available at https://gcn.nasa.gov/missions/fermi Or, just update the existing one as single page?

@Vidushi-GitHub
Copy link
Member

Those are two independent schemas intended to describe the same notice type:

  • The "Kafka" one: fermi/gbm/FermiGBMAlert.schema.json

    • Makes $ref-s to the core schema.
    • Doesn't $ref the strict schema.
    • Validates new notices received by the Kafka server.
    • More permissive compared to the strict schema.
  • The "strict" schema: fermi/gbm/strict/FermiGBMAlert.schema.json:

    • Doesn't $ref the core schema, nor the "Kafka" schema.
    • Is less permissive than the Kafka schema.
    • Clarifies what to expect in a notice, incl. which core fields are not used.
    • Used by the producer, in addition to the Kafka schema.

[Edit:] I should rename the strict schema file so it has a different name.

I am trying to understand why do you wanna create two schemas for same notice types? What is advantage of not referring $ref or kafka schema? Would you produce same notices from two schemas?
Definitions/clarifications shouldn't be problem, that can be added in alert schema as well.

@lpsinger, @jracusin do you have comments on the same notices from different schemas, alert ($ref to core) and strict (own definitions)?

@shb46
Copy link
Contributor Author

shb46 commented Oct 10, 2024

@jracusin:
Re. separate GBM/LAT pages.
Please let me know if it is possible. If yes, we should get the consensus of the GBM and LAT teams before we make a change. I think it will work with or without a "mission" page, i.e. either one of:

  • Missions
  • Fermi
  • GBM
  • LAT

or

  • Missions
  • FermiGBM
  • FermiLAT

@shb46
Copy link
Contributor Author

shb46 commented Oct 10, 2024

@Vidushi-GitHub: File renamed. The JPG and MD files removed.

@shb46
Copy link
Contributor Author

shb46 commented Oct 11, 2024

@jracusin: P.S.: I'm not planning to change the mission page at this time.

@dakota002
Copy link
Contributor

Hi @shb46 , I have a couple additional requests for this update:

Can you rename the strict schema and examples as well:

  • gcn/notices/fermi/gbm/strict/FermiGBMStrictAlert.schema.json -> gcn/notices/fermi/gbm/strict/alert.schema.json
  • gcn/notices/fermi/gbm/strict/FermiGBMAlert1.example.json -> gcn/notices/fermi/gbm/strict/alert.FermiGBMAlert1.example.json
  • gcn/notices/fermi/gbm/strict/FermiGBMAlert2.example.json -> gcn/notices/fermi/gbm/strict/alert.FermiGBMAlert2.example.json
  • gcn/notices/fermi/gbm/strict/FermiGBMStrictAlert1.example.json -> gcn/notices/fermi/gbm/strict/alert.FermiGBMStrictAlert1.example.json
  • gcn/notices/fermi/gbm/strict/FermiGBMStrictAlert2.example.json -> gcn/notices/fermi/gbm/strict/alert.FermiGBMStrictAlert2.example.json

The schema name change reason is the same as the other schema as @Vidushi-GitHub mentioned, as the path already gives the name. As for the examples, the pattern of: alert.[any specific name for the example].example.json is recognized in our schema browser and parsers, and will help automate our docs.

Once this is all set, could you then squash your commits down to 1 single commit? I can assist in this if you have questions before doing so.

@shb46
Copy link
Contributor Author

shb46 commented Oct 11, 2024

Hi, @dakota002,

Please check the new file names before squashing.

@dakota002
Copy link
Contributor

Hi, @dakota002,

Please check the new file names before squashing.

The names look good to me!

@shb46
Copy link
Contributor Author

shb46 commented Oct 11, 2024

@dakota002: Did I squash it enough?

@dakota002
Copy link
Contributor

@dakota002: Did I squash it enough?

I don't believe so, I see 52 commits now. You may have pulled the history back into your branch before pushing it out. You should just run the command git push -f to assert that the new history is correct

@shb46
Copy link
Contributor Author

shb46 commented Oct 14, 2024

@dakota002: Can't figure it out. I'm going to need your help with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants