Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

weather-sp: Provide an option to append the filename with the splitted filename. #345

Open
deepgabani8 opened this issue Jun 12, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@deepgabani8
Copy link
Collaborator

deepgabani8 commented Jun 12, 2023

Currently, weather-sp provides an option to set the filename of the splitted file.

For example, for the input file --input-pattern 'gs://bucket-name/2017-1-sp-10u-10v-2t-2d-tp-ptype.gb', I provided --output-template 'gs://bucket-name/monthly-splitted/{date}{time}/{step}/{date}{time}_FH-{step}.gb' and it created splitted files like gs://bucket-name/monthly-splitted/201201010000/0/201201010000_FH-0.gb.

This input file is for a few variables. Now in the future, when a new raw file for a new variable comes for the same timestamp, I cannot split that file in the monthly-splitted folder, because it will override the files as they just includes date, time and step. What I really want is an option to have a functionality to append the raw data filename to the splitted data filename. Somewhat like ability to provide that in the --output-template argument only like --output-template 'gs://bucket-name/monthly-splitted/{date}{time}/{step}/{filename}_{date}{time}_FH-{step}.gb'

@deepgabani8 deepgabani8 added the enhancement New feature or request label Jun 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant