Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Raw ERA5 data automatically downloading on a cron. #36

Merged
merged 8 commits into from
Jul 31, 2023

Conversation

dabhicusp
Copy link
Collaborator

No description provided.

raw/README.md Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/Dockerfile Outdated Show resolved Hide resolved
raw/README.md Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch.py Outdated Show resolved Hide resolved
raw/fetch_test.py Outdated Show resolved Hide resolved
raw/fetch_test.py Outdated Show resolved Hide resolved
raw/Dockerfile Outdated Show resolved Hide resolved
raw/Dockerfile Outdated Show resolved Hide resolved
raw/README.md Outdated Show resolved Hide resolved
raw/README.md Outdated Show resolved Hide resolved
raw/README.md Outdated Show resolved Hide resolved
raw/fetch.py Show resolved Hide resolved
Copy link
Collaborator

@alxmrs alxmrs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few very minor nits. Once fixed, please merge & deploy this change! 🎊

raw/fetch.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@mahrsee1997 mahrsee1997 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

raw/fetch.py Show resolved Hide resolved
@dabhicusp dabhicusp merged commit bd155ff into google-research:main Jul 31, 2023
1 check passed
@dabhicusp dabhicusp deleted the data_automate branch July 31, 2023 16:49
@dabhicusp dabhicusp restored the data_automate branch August 14, 2023 04:55
dabhicusp added a commit that referenced this pull request Aug 14, 2023
@dabhicusp dabhicusp deleted the data_automate branch August 14, 2023 04:58
dabhicusp added a commit that referenced this pull request Aug 16, 2023
Upon merging PR #39 (`Added lnsp & zs config files`) into the main
branch, it was discovered that the code from PR #36 (`Raw ERA5 data
automatically downloading on a cron`) could not effectively handle files
with `lnsp and zs` in their filenames. As a result, I have made
necessary updates to the `fetch.py` script to address this issue. The
updated code has been implemented and tested, ensuring seamless
functionality.

After these modifications, I successfully downloaded the data using the
enhanced script which is stored in the following directories:

`gs://gcp-public-data-arco-era5/raw/ERA5GRIB/HRES/Daily/2023/202305**_hres_**.grb2`

`gs://gcp-public-data-arco-era5/raw/ERA5GRIB/HRES/Month/2023/202305**_hres_**.grb2`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants