Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release V7.0.0 #262

Merged
merged 127 commits into from
Jan 25, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
127 commits
Select commit Hold shift + click to select a range
1e64272
adds ASFProduct subclasses for S1, S1 Burst, ALOS, and Radarsat products
Sep 15, 2023
a69c6a2
adds several dataset ASFProduct classes (based on existing platform c…
Sep 19, 2023
f7b4f67
Merge branch 'master' into topic-ASFProduct-subclassing
Nov 9, 2023
824ef4f
moves import around again, asf-search now imports again
Nov 9, 2023
90e158e
products now built from corresponding dataset product type
Nov 9, 2023
40b60b7
removes dependency on global umm path dict, adds OPERAS1Product subclass
Nov 10, 2023
d77f321
all dataset results now map to dataset product type
Nov 11, 2023
8f89266
adds arias1gunwproduct type
Nov 11, 2023
051c7cf
Merge branch 'master' into topic-ASFProduct-subclassing
Nov 11, 2023
2fdcfc2
adds DATASET constants, limits constant imports to modules
Nov 15, 2023
f44549b
updates changelog
Nov 15, 2023
3c8dc3f
updates example notebook constant imports
Nov 15, 2023
d5e1514
adds platform->concept-id dict used in translate.py when querying CMR…
Nov 16, 2023
3545799
moves dataset/platform collection aliasing into subquery.py, adds pro…
Nov 16, 2023
b53aea3
adds build_subquery test cases
Nov 16, 2023
8839056
adds extra edge case tests
Nov 17, 2023
06d7ad9
adds more test cases
Nov 17, 2023
1ad1c8f
cleanup, adds changelog
Nov 17, 2023
45f520e
comments out processingLevel concept-id aliasing (for now)
Dec 4, 2023
9969a63
Merge branch 'master' into topic-dataset-constants
Dec 4, 2023
fa21107
Merge branch 'master' into topic-ASFProduct-subclassing
SpicyGarlicAlbacoreRoll Dec 4, 2023
6eb8ab4
adds baseline functionality to other product types
Dec 5, 2023
fd09d18
update test_stack import
Dec 5, 2023
af19ea9
update test case
Dec 5, 2023
751d19a
another test case update, asfproduct cleanup, s1product cleanup
Dec 5, 2023
b8ce44b
updates more test cases, fixes typo in s1product stacking logic
Dec 5, 2023
5bc8751
updates a lot of test cases, adds some product type specific fields
Dec 6, 2023
5aae1c4
removes old test case
Dec 6, 2023
a0148d7
more test cases for more products, updated test cases, commented out …
Dec 6, 2023
28687e2
Merge branch 'master' into topic-ASFProduct-subclassing
Dec 7, 2023
281616f
grab first browse for ERS
Dec 7, 2023
82651e5
ers products use center_esa_frame
Dec 7, 2023
9469e5b
fixes typo in umm pathing
Dec 7, 2023
d8d5462
update yml test data, update geojson output test
Dec 7, 2023
023b38d
removes ers test case due in test_search
Dec 7, 2023
9626636
removes ummfields module
Dec 7, 2023
241cf8e
adds validityStartDate support to opera s1 products
Dec 8, 2023
4329269
Merge branch 'master' into topic-ASFProduct-subclassing
Dec 8, 2023
e7629ab
adds BaselineCalcType enum that defines baseline stacking type
Dec 15, 2023
e08ddd8
moves several common property fields to ASFProduct base class, adds s…
Dec 19, 2023
8941d59
harmonizes asf-search handling of missing statevectors with SearchAPI
Dec 20, 2023
24246bf
Adds warning when missing state vectors for relevant baseline stacks
Dec 21, 2023
36389b2
update changelog
Dec 21, 2023
43d9810
update key access for ASFProduct properties testing
Dec 22, 2023
13512ad
Merge branch 'master' into topic-ASFProduct-subclassing
SpicyGarlicAlbacoreRoll Dec 22, 2023
805116f
adds dataset shortname fallbacks for subproduct class assignment
Dec 27, 2023
949ffd0
Merge branch 'topic-ASFProduct-subclassing' of https://github.com/asf…
Dec 27, 2023
ae96099
adds helper method for converting products in ASFSearchResults while …
Dec 28, 2023
d69f578
adds ASFSearchResults helper methods, get_products_by_subclass_type a…
Dec 29, 2023
c28e1ef
adds ASFProduct get_classname classmethod
Dec 29, 2023
a80172c
removes get_by_properties helper method, adds doc string to get_produ…
Dec 29, 2023
a0dbabc
adds more doc strings for ASFProduct, and asf_search.CMR.translate.get()
Dec 29, 2023
0cf521a
adds docstring for subproducts with links to ASF documentation. Remov…
Jan 4, 2024
194e486
lets s1burst xml download with custom filenames
Jan 4, 2024
892a22e
Merge branch 'topic-ASFProduct-subclassing' into topic-ASFProduct-sub…
SpicyGarlicAlbacoreRoll Jan 4, 2024
1f92401
Merge pull request #253 from asfadmin/topic-ASFProduct-subclassing-Ba…
SpicyGarlicAlbacoreRoll Jan 4, 2024
98ddf52
moves BaselineCalcType enum
Jan 4, 2024
e8291d7
fixes baseline stacking enum import issue, moves enum class def into …
Jan 5, 2024
1d4e68b
updates baseline test case
Jan 5, 2024
54a7f63
re-adds get_default_product_type, make more clear it's baseline related
Jan 5, 2024
4b1623b
changes method name and call in download(), adds _
Jan 5, 2024
ca072ad
Makes prefixes base_properties with _, removes from access method
Jan 5, 2024
6397226
moves get() from translate.py to ASFProduct class as static method
Jan 5, 2024
dcf2177
fixes possible None val in list comprehension, re-adds get_additional…
Jan 5, 2024
7b5d871
fixes typo from earler commit
Jan 6, 2024
038239b
Fixes List type importing source
Jan 6, 2024
c799de5
returns default product type method, changes name
Jan 8, 2024
1c91fd6
Merge branch 'master' into topic-ASFProduct-subclassing
SpicyGarlicAlbacoreRoll Jan 10, 2024
6220e55
Merge branch 'master' into perpendicular-baseline-harmonization
SpicyGarlicAlbacoreRoll Jan 10, 2024
d37db4d
makes remotezip an optional dependency under "extras", raises warning…
Jan 10, 2024
f9d0763
Merge branch 'master' into topic-dataset-constants
SpicyGarlicAlbacoreRoll Jan 10, 2024
239423d
adds test to assert results are similar between asf-search and search…
Jan 10, 2024
3881647
Merge branch 'topic-dataset-constants' of https://github.com/asfadmin…
Jan 10, 2024
a88e452
uncomments processingLevel->concept-id aliasing
Jan 10, 2024
71e5955
adds exception reraise to test method query_endpoint()
Jan 10, 2024
c14d612
breaks up concept-id related methods in build_subqueries()into separa…
Jan 11, 2024
6e3299c
fixes collection set building in subquery.py
Jan 11, 2024
cc74972
refactors/cleanup some subquery logic
Jan 11, 2024
49624b2
build_subquery(): improves variable names, simplifies some logic
Jan 11, 2024
9c48e58
adds collectionAlias ASFSearchOptions keyword, allows bypassingconcep…
Jan 12, 2024
003663e
forward declaration, only tries importing RemoteZip once, raise impor…
Jan 12, 2024
06670e0
adds way to convert to subclass while stacking products
Jan 12, 2024
5e2b586
removes bad import from baseline_search
Jan 12, 2024
3def216
removes ASFProduct import from ASFSearchResults
Jan 12, 2024
1805087
adds example notebook for ASFProduct subclasses, and how to write cus…
Jan 13, 2024
36b108f
renames subclass notebook example class, adds test case to notebook t…
Jan 16, 2024
ca5f812
fixes yml typo
Jan 16, 2024
20642c5
makes ASFProduct get_stack_opts() return None by default
Jan 16, 2024
446308f
Merge branch 'topic-ASFProduct-subclassing' into topic-ASFProduct-sub…
Jan 16, 2024
3e5387b
removes product subclass casting from ASFProduct class, makes standal…
Jan 16, 2024
bc34d1b
updates subclassing notebook, shows example of overriding ASFProduct.…
Jan 17, 2024
10291d1
removes unused import
Jan 17, 2024
6496803
removes _try from _try_cast methods in baseline_search.py
Jan 17, 2024
115f587
Cleans up some logic, fixes type hinting for Dict and List, removes o…
Jan 18, 2024
88bb66f
adds offNadirAngle field for kml and csv output parity with SearchAPI
Jan 18, 2024
115e0ce
chore: fix whitespace to follow pep8
williamh890 Jan 18, 2024
16a0c79
chore: small refactors for readability
williamh890 Jan 18, 2024
faaece6
Merge branch 'topic-ASFProduct-subclassing' into topic-ASFProduct-sub…
Jan 18, 2024
7ed6fa1
tweaks notebook some more
Jan 18, 2024
4ab884b
feature: add ASFBaselineProduct subclass
williamh890 Jan 18, 2024
19ec81f
renames ASFBaselineProduct to ASFStackableProduct
Jan 18, 2024
78e3ae5
Merge branch 'topic-ASFProduct-subclassing' into topic-ASFProduct-sub…
Jan 18, 2024
afc981e
makes ARIAS1GUNWProduct and OPERAS1Product not stackable (for now), u…
Jan 19, 2024
8e4c6b2
fix: wrong placement of default is_valid_reference() in S1Product
Jan 19, 2024
edf5433
adds: opera calibration datasets (OPERA-S1-CALIBRATION and OPERA-S1-C…
Jan 23, 2024
ace7fea
add: Makes ASFSession more flexible with constructor parameters/class…
Jan 24, 2024
29f9681
chore: adds OPERA_S1_CALIBRATION constant, update CHANGELOG
Jan 24, 2024
3d56f53
Merge pull request #261 from asfadmin/topic-ASFSession-constants
SpicyGarlicAlbacoreRoll Jan 24, 2024
51c585c
Merge branch 'master' into topic-opera-calibration-datasets
SpicyGarlicAlbacoreRoll Jan 24, 2024
99a2966
Merge pull request #260 from asfadmin/topic-opera-calibration-datasets
SpicyGarlicAlbacoreRoll Jan 24, 2024
9d878e6
Merge pull request #256 from asfadmin/topic-ASFProduct-subclassing-pr…
SpicyGarlicAlbacoreRoll Jan 24, 2024
011578b
Merge branch 'master' into perpendicular-baseline-harmonization
SpicyGarlicAlbacoreRoll Jan 24, 2024
c9cf2b2
moves missing state vector count into method
Jan 24, 2024
1efbbe0
Merge pull request #248 from asfadmin/perpendicular-baseline-harmoniz…
SpicyGarlicAlbacoreRoll Jan 24, 2024
927d621
Merge branch 'master' into topic-dataset-constants
SpicyGarlicAlbacoreRoll Jan 24, 2024
2bf6b21
Merge pull request #238 from asfadmin/topic-dataset-constants
SpicyGarlicAlbacoreRoll Jan 24, 2024
6a1bd25
Merge master into topic-ASFProduct-subclassing
Jan 24, 2024
806867b
Merge pull request #225 from asfadmin/topic-ASFProduct-subclassing
SpicyGarlicAlbacoreRoll Jan 24, 2024
e54c331
Merge branch 'master' into optionalize-remotezip
SpicyGarlicAlbacoreRoll Jan 24, 2024
7eef0c5
adds conda install mention in remotezip ImportError message
Jan 24, 2024
e296d74
fix: fixes ASFSession to work with multiprocessing. Fix base class _p…
Jan 24, 2024
87c8a7a
Merge branch 'master' into optionalize-remotezip
SpicyGarlicAlbacoreRoll Jan 24, 2024
a1c603b
Update CHANGELOG.md
SpicyGarlicAlbacoreRoll Jan 24, 2024
51a3e93
Merge branch 'stable' into master
SpicyGarlicAlbacoreRoll Jan 24, 2024
790ad5c
Merge pull request #255 from asfadmin/optionalize-remotezip
SpicyGarlicAlbacoreRoll Jan 24, 2024
3f65f06
chore: normalize capitalization for dataset products that are acronyms
Jan 25, 2024
867c8e5
Merge pull request #263 from asfadmin/topic-capitalization-fixes
glshort Jan 25, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/run-pytest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ jobs:
- name: Install Dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install .[test]
python3 -m pip install .[extras,test]

- name: Run Tests
run: python3 -m pytest -n auto --cov=asf_search --cov-report=xml --dont-run-file test_known_bugs .
Expand Down
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -130,3 +130,5 @@ dmypy.json

# VS Code
.vscode/
search_results.csv
search_results.metalink
26 changes: 26 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,32 @@ and uses [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
-

-->
------
## [v.7.0.0](https://github.com/asfadmin/Discovery-asf_search/compare/v6.7.3...v.7.0.0)
### Added
- `ASFProduct` now has 13 sublcasses for different sub-products that correspond to datasets:
- `S1Product`, `S1BurstProduct`, `OPERAS1Product`, `ARIAS1GUNWProduct`, `ALOSProduct`, `RADARSATProduct`, `AIRSARProduct`, `ERSProduct`, `JERSProduct`, `UAVSARProduct`, `SIRCProduct`, `SEASATProduct`, `SMAPProduct`
- Each subclass defines relevant keys to pull from `umm` response, reducing the amount of irrelevant values in `properties` dict for certain product types
- Adds `collectionAlias` to `ASFSearchOptions` validator map as config param. Set to `False` to disable concept-id aliasing behaviour for `processingLevel` and `platform`.
- Adds warning when scenes in stack are missing state vectors, and logs baseline warnings with `ASF_LOGGER`
- Adds `OPERA-S1-CALIBRATION` entry to `dataset_collections` and corresponding `OPERA_S1_CALIBRATION` constant to `DATASET.py`, used to search for OPERA-S1 `CSLC` and `RTC` calibration data.

### Changed
- `remotezip` is now an optional dependency of asf-search's pip and conda installs, (pip install example: `python3 -m pip install asf-search[extras]`).
- Constants are no longer top level import, are now accessible through respective modules
- `processingLevel` and `platform` are now aliased by collection concept-ids, (lists of concept ids by their processing levels/platforms viewable in `dataset.py`), improving search performance and dodging subquery system
- Baseline stacking no longer excludes products with missing state vectors from final stack, like SearchAPI
- `OPERA-S1` dataset no longer includes calibration data (moved to new dataset)
- Adds optional `ASFSession` constructor keyword arguments for new class variables:
- `edl_host`
- `edl_client_id`
- `asf_auth_host`
- `cmr_host`
- `cmr_collections`
- `auth_domains`
- `ASFSession` imports `asf_search.constants.INTERNAL` in constructor call
- `ASFSession` methods `auth_with_creds()`, `auth_with_token()`, and `rebuild_auth()` use new class variables instead of constants

------
## [v6.7.3](https://github.com/asfadmin/Discovery-asf_search/compare/v6.7.2...v6.7.3)
### Added
Expand Down
Loading
Loading