weather-dl v2 #408
Merged
weather-dl v2 #408
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Cli Init * Added network service. * Added Download subcommand and service. * Added Queue subcommand and service. * Added License subcommand and service. * Updated readme and dockerfile. * Update README.md * Update Dockerfile * updated readme * added missing logger * added logs before exiting in network service
* Refactored DB layer. * added logger * added logger to new db layer * added mock databases * added mock databases * Added Integration tests for download. * Fixed license handler and router after mc. * Added license integration tests * Added integrations tests for queue. * fixed lint issues * ignore ruff for a test * removed old db_service * refactor license deployment * updated queue modify priority * removed integration tests * fastapi server minor fixes * updated logger * Update main.py * revert pyproject.toml * Update pyproject.toml * Update pyproject.toml * fixes in license deployment * updated license handler for secret manager
* added tests for fast-api server * added test for absolute license priority * minor fix
* updated vm creation command * cli lint fixes * revert pyproj * seperated startup script * updated readme * fixed typo
* Added pending deployments on server bootup. * minor refactoring in db layer * using create license deployment from license route * updated args in downloader * minor fix
* added pyink to env ymls * formatting changes * updated readme * lint fixes * remove pyink from env
* added server config * added global state for config and db session * seperated server config json * minor fix * minor nit: updated var name
* parallel queury for aggregating config stats and manifest handler * get download routes * mock manifest_handler and updated download tests * updated manifest collection in config * lint fixes * updated config stat response * removed extra db call for get download by config * updated manifest collection name * lint fixes
* added firestore async client * minor fixes * updated database handlers * Readme updates. * .gitkeep -> config_files folder. * fixed download add call. * queue handler fix * Fix _update_queues_on_stop_download db call. * Fix file upload on fastapi server. * Improved logging. * Fix download add functionality. * cli condition fix * adding additional configs from queue priority * Added a check in priority_queue list route. * lint fixes * print -> logger.info in queue_handler.py. * removed print statements --------- Co-authored-by: Rahul Mahrsee <rahul@infocusp.in>
* added config refetching * added cli command for refetch * updated docs * added license check * loader for cli
* added deployment config * added cli config * command to see and update server ip address. * added basic tools to docker container * lint fixes * minor fix, removed pring stmt * minor fix, cli * minor fix, cli * minor fix, license dep * minor fix, server
* added gsutil to cli container * updated license id as user input * added license_id to cli license add command * minor fix * updated cli readme * minor fix
* added additonal filter params to download * added additional filter to cli validation * minor fixes * minor nit and updated cli docs * minor doc fix * allow multiple filters fix * updated inprogress filter * updated help string cli * Update cli docs
* added downloader config * added downloader k8 image to deployment_config * added license deployment image to server_config * added license id to error msg for failed manifest * lint fixes * minor nit * minor nit
* minor fixes and upgrades * updated network service in cli
* added option to view data as table * updated dependencies * minor fix * set table default response
* Updating queue client_name when license is updated. * nit: updated method name
* updated logger * fixed logger
* minor changes * lint fix
* added GCS storage capabltiy to server * updated refetch partition to use config from gcs storage * lint fixes * added cli command to show config and updated docs * nit fixes * updated comments for dl-v2
* updated cli docs * updated cli doc
* updated config files for all services * added config maps to all services * added config.json * updated readmes * fixed downloader yml * updated config.json(s) * removed config folder * updated get_config * updated readmes
* lint fixes in downloader_k8s * removed comment
* lint fixes in downloader_k8s * removed comment * added license to dl-v2
* lint fixes * minor fix
* fixed license tests * fixed download tests * fixed license tests * updated name for missing config condition * updated readme * skipping dl-v2 tests in CI
deepgabani8
approved these changes
Nov 1, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.