-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Stable version of the fiat_integrator #124
Merged
Merged
Changes from 250 commits
Commits
Show all changes
384 commits
Select commit
Hold shift + click to select a range
f93f9e0
Added the driver as GPKG to write_geoms to write correctly the geopac…
frederique-hub 9a7f3af
Changed spatial_reference to elevation_reference for FIAT config file
frederique-hub bb7529e
Updated hydromt-fiat-dev.yml
frederique-hub cb02c64
Fixed geojson format in the gpkg, now its really saved as a gpkg
frederique-hub e364e53
get_tables does not exists
srpeiter 7e79af7
Fix in fiat.py and update test_integrations_hazard.py
frederique-hub 130d24b
Merge branch 'fiat_integrator' of https://github.com/Deltares/hydromt…
frederique-hub 9cc57ed
fix issue with exxtraction method
srpeiter 5dba60c
Merge pull request #111 from Deltares/fiat_integrator_fix
srpeiter 2deb0ca
Reading geoms and saving in object ExposureVector.exposure_geoms
frederique-hub e2a09a3
Merge branch 'fiat_integrator' of https://github.com/Deltares/hydromt…
frederique-hub 53eb204
Update to charleston area
frederique-hub 76c067b
removed commented line
frederique-hub e7d96a3
Added hydromt_sfincs to the environment yml
frederique-hub 8fafd99
Updates reading and writing vulnerability_curves.csv
frederique-hub 690201b
Updates to fix bugs in reading in an existing model
frederique-hub 75a3a75
Bugfixes after running tests.
frederique-hub 4155846
Updated tests and implamented gdal compliance for netCDFs
frederique-hub 885cd5e
Skip hazard test, for @Mares2022 to improve later
frederique-hub c0c1dc1
Added test data
frederique-hub 0a20dfc
Added cache folder to the gitignore
frederique-hub 2a6c902
Updated tests with new test data on the repos
frederique-hub 82e3fda
modified to run fiat risk
srpeiter f716a7f
Merge branch 'fiat_integrator' of github.com:Deltares/hydromt_fiat in…
srpeiter 976b234
Delete uitls
frederique-hub 319c399
Modification of loadflood maps tool
Mares2022 da5d9f9
Change hazard to make it compatible with sfincs inputs
Mares2022 55298fd
Update test to read only maps without rp dimension
Mares2022 24293fc
merged with fiat_integrator
Mares2022 c31cb42
Merge pull request #114 from Deltares/fiat_integrator_hazard_risk
Mares2022 efd1bf4
commiting before pulling mario changes
srpeiter 3bd1389
commiting before pulling mario changes, second time
srpeiter 98865a2
merged with fiat_integrator branch from local fiat_integrator branch
srpeiter b4f4376
typo in fiat setting toml file fixed: return_period to return_periods
srpeiter f616bcf
Updated typehinting in select_objects function
frederique-hub 758bfdb
Merge branch 'fiat_integrator' of https://github.com/Deltares/hydromt…
frederique-hub 3436286
Correct netCDF files to be compatible with Delft-fiat
Mares2022 ca00fbd
Merge branch 'fiat_integrator' of https://github.com/Deltares/hydromt…
Mares2022 dcfd4a9
Updating test_integration_hazard.py with multiple inputs (geotif, sfi…
Mares2022 b238b5c
Update test_integration_hazard.py
Mares2022 b6f1e9e
Changed scale to step_size
frederique-hub c5ce9a2
Implemented the possibility to have multiple exposure_geoms in the Ex…
frederique-hub 78bd68f
Updating tests and fixing bugs after the change from a single to mult…
frederique-hub eaae16d
Added update_all to the write method
frederique-hub 25b224c
Removing pre-existing test results
frederique-hub d6bc36a
Saving multiple gkpg with different names
frederique-hub 549b86e
Added extraction method assignment in the truncate damage function an…
frederique-hub 8e17eda
Testing with two damage function types
frederique-hub 602e9a3
Aligned names of the new damage function for the new_composite_area
frederique-hub 71671dd
Merge branch 'fiat_integrator' of https://github.com/Deltares/hydromt…
frederique-hub 984232b
Removing dependencies on the columns X coordinate and Y coordinate (N…
frederique-hub 6ad61c7
Added comment
frederique-hub 6a5bec6
Updated hydromt version to 0.7.1 and added hydromt_sfincs
frederique-hub c43cad7
Deleted redundant data catalog
frederique-hub e35141e
Added standard global data catalog
frederique-hub 1ff026e
Deleted old example
frederique-hub 1007757
Updated and added preprocessed JRC damage functions and values
frederique-hub a5c4310
Added a global data catalog
frederique-hub 6936c73
Updated example data
frederique-hub 038e6b7
Updates related to the test_vulnerability_exposure_global_default. Ad…
frederique-hub 4a89e0e
Updated environment files and removed rasterio
frederique-hub 4dd4792
Added osmnx
frederique-hub 2a37784
Specified Pydantic version 1.10.9 to comply with FloodAdapt
frederique-hub 6ba8395
Fixed formatting issue of version dependencies
frederique-hub 5af6aa8
Trying again to fix the dependencies syntax
frederique-hub d3433cf
Fixed typing import, upgrade pydantic to version 1.10.9
frederique-hub 3606e72
Successfully written a model from OSM and JRC data
frederique-hub f11acc6
Reversed the removal of the Link column, added a damage type column (…
frederique-hub a4b25f2
Final update environment files
frederique-hub 3187200
Update to newer HydroMT core version
frederique-hub ee16141
Update test and related files
frederique-hub 7cfea28
Fixing code according to make test_vulnerability_exposure pass
frederique-hub 44ba5a9
Updated test and added an example for default global model building
frederique-hub 9f8d5a7
Added ipykernel for the examples
frederique-hub ce64a83
Changed test location to the folder on the P-drive
frederique-hub ce01201
Reversed back to kwargs to comply with the 7.1 version of HydroMT
frederique-hub e36a4ec
Deleted randomly appeared file
frederique-hub 93f9805
added the result from the example to the .gitignore
frederique-hub 56fce6d
Finalized first version of the global_OSM_JRC example
frederique-hub 945d35a
Removed pandas
frederique-hub 95da43f
Implemented an assert for the rase ground floor height test
frederique-hub 32c4dea
Updated notebook explainers, and added domain definition through a ge…
WOTrompDeltares 87fb929
Added more assert statements to tests
frederique-hub 935849e
Merge pull request #126 from Deltares/TutorialNotebookDev
frederique-hub 6cc8093
Small textual revisions after Willems update
frederique-hub 347a821
Added functionality to read separate vulnerability curves from csvs a…
frederique-hub a4c6b64
Finalized reading function from multiple csvs and test including asserts
frederique-hub 830684f
added more assert statements
frederique-hub 7c2d9ce
Updated functionality to use user-input land use data
frederique-hub 41b5698
Updated tests including asserts
frederique-hub ce911de
Updated tests with asserts
frederique-hub d289bf3
Changed Python version in testing to 3.10
frederique-hub e9eaa40
Updated docs
frederique-hub a7a74e1
Updated readme's
frederique-hub cffb0b7
Small fix to get the gdf before filtering
frederique-hub 73a995a
Update configuration variable
frederique-hub 1c1c5d0
Updating to HydroMT version 0.8.0
frederique-hub a5aea97
change kwargs into driver_kwargs with HydroMT version 0.8.0
frederique-hub 4ccc51c
Added units for vulnerability and exposure
frederique-hub e6d3377
Added unit conversion for the sfincs output
frederique-hub b1833a7
Merge pull request #127 from Deltares/env_fix
frederique-hub 4175663
Added pyogrio to the dependencies
frederique-hub 2e72302
Added pyogrio driver to all the gpd.read_file functions
frederique-hub 45cf33e
Fixed bug in double saving exposure geom files with names different f…
frederique-hub 6402da5
added option for bfe from table when elevating
panosatha ef79211
Updated social vulnerability module
LiekeMeijer 2bc81ef
Merge branch 'fiat_integrator' of https://github.com/Deltares/hydromt…
LiekeMeijer 8f5464d
Changes name of the sfincs map when doing a risk calculation
frederique-hub 6cc1093
Merge pull request #130 from Deltares/128-read-bfe-from-csv
frederique-hub 5a03a21
changed back to working version
panosatha c0e1a36
Merge pull request #131 from Deltares/correct_risk_mapping
panosatha 177adb8
small update in settings toml
panosatha 3132a34
Merge pull request #136 from Deltares/env_fix
frederique-hub 4609f96
adding aggregation function
Santonia27 ef2ebe2
Comments and todos for the hazard functionality
frederique-hub 34450e9
Cleaning database
frederique-hub 4906f9c
Added default US vulnerability curves (file not in repos yet, first n…
frederique-hub 716cf1c
Updated workflows, to be tested when pushing to the main branch.
frederique-hub 95e8872
Removed all docs dependencies
frederique-hub 331beb6
Added an environment for the docs
frederique-hub 690c2b7
Moved the global data catalog to the examples folder
frederique-hub bea0804
Updated path according to the move of the hydromt_fiat_catalog_global…
frederique-hub ccc9d14
starting to use multiple aggregation layers
Santonia27 58f2e00
finish single aggregation file
Santonia27 6001de8
update
frederique-hub 026b74f
Added missing depencendy us
frederique-hub 1e69ef1
Update documentation
frederique-hub 16a20ba
create script to add unlimited aggregation areas - needs refinement
Santonia27 1adc043
updated test for single&multipe aggregation areas
Santonia27 86b79c5
corrected unit conversion bug for risk
panosatha 9a12420
if statement iterating column names by attribute
Santonia27 e4131af
Update of documentation
frederique-hub fe4e56c
Merge pull request #139 from Deltares/#116-Online-documentation
frederique-hub 609ffd0
Moved to the examples folder
frederique-hub d488ced
Merge branch 'fiat_integrator' into #135-hazus-damage-functions-linki…
frederique-hub 4e28cdf
test 3 cases
Santonia27 1ae3736
Merge pull request #138 from Deltares/#135-hazus-damage-functions-lin…
Mares2022 2651724
Applied black, implemented the geom_names variable for ExposureVector…
frederique-hub 2f5bcd0
Ordering return periods and adding them as new bands in the netcdf
Mares2022 e609e0a
Updated tests according to changes issue #137
frederique-hub 4d5b37b
Update docstring
frederique-hub 482abd4
First commit for issue #140
frederique-hub 3bfbf96
dropping duplicates and aggregation overlapin list
Santonia27 afcce8e
transform single list values into variable
Santonia27 1d427a4
everything in one loop
Santonia27 4faa5cc
Deleted pygeos as dependency because of the migration to shapely with…
frederique-hub cb26fd5
updated overlap function
Santonia27 2575f16
Updated code according to dependency warning messages and continued t…
frederique-hub 686d08a
Merge pull request #141 from Deltares/#137-allow-to-use-different-nam…
frederique-hub 47431bc
Merge branch '#140-Allow-user-input-data-for-occupancy-type-and-match…
frederique-hub 6440972
Merge pull request #143 from Deltares/fiat_integrator
frederique-hub bff635f
Both exposure from OSM download and user-input land use data and user…
frederique-hub a1c1b87
Merge pull request #144 from Deltares/#140-Allow-user-input-data-for-…
frederique-hub 98deeaa
My suggestion for finalizing the code - it must be tested though!
frederique-hub a229f70
Moved a few functions to the new gis.py file
frederique-hub fa51da4
Update with new function to join_spatial_data (generic function for a…
frederique-hub 5cfaa83
Update function to add data
frederique-hub 1342ff8
adding the correct import package names
Santonia27 aa307f3
Merge branch '#64FlexibleAggregationArea' into fiat_integrator
frederique-hub 18ad6b2
Merge pull request #148 from Deltares/fiat_integrator
frederique-hub 59e6b54
Implemented the join_spatial_data function a bit better with some checks
frederique-hub 8e1bf45
Update docs.yml
frederique-hub 54a069d
updated according to freqeriques code
Santonia27 78670bf
Delete .github/workflows/tests.yml
frederique-hub c4be3ac
Create vulnerability.rst
frederique-hub bf601f7
Added missing data to the example
frederique-hub 3ce4629
Update user_guide_overview.rst
Santonia27 4db8569
Merge branch '#64FlexibleAggregationArea' of https://github.com/Delta…
Santonia27 5af8bbf
Update user_guide_overview.rst
Santonia27 efe3ad0
Update docs
frederique-hub d629453
Merge pull request #149 from Deltares/#116-Online-documentation
frederique-hub 44638f9
Update user_guide_overview.rst
Santonia27 58c9375
Update user_guide_overview.rst
Santonia27 93f1007
Create Example notebook for aggregation zones
Santonia27 d01e0e8
Merge branch '#64FlexibleAggregationArea' of https://github.com/Delta…
Santonia27 1d78b18
deleted notebook, error
Santonia27 b70f967
example notebook aggregation zones
Santonia27 8e22d02
First draft aggregation example Notebook
Santonia27 c011e44
update first draft
Santonia27 05cf6d7
update aggregation notebook
Santonia27 00ed9bb
updated file path
Santonia27 54df137
Change file path, Update notebook, create yaml file for aggregation c…
Santonia27 8e6a944
insert interactive geopandas map
Santonia27 b598ecf
update notebook, adding example data. Must be updated
Santonia27 dfb1ff3
changed order
Santonia27 1448ad3
order update
Santonia27 f581d84
add legend to map
Santonia27 66e7bcc
Removal of redundant functions, integration of grid functions to save…
Mares2022 7762c92
Updated the test data, it comes from NSI (exposure) and Hazus default…
frederique-hub 1ad8620
update interactive map and fix environment. Model run
Santonia27 3ac5731
final commit of the day
Santonia27 2f6f3e6
update notebook
Santonia27 959a29c
aggregation zone fine tuning
Santonia27 2baccd3
Merge branch 'fiat_integrator' into #64FlexibleAggregationArea
frederique-hub e7b6842
Update aggregation relative path user_guide_overview.rst
Santonia27 c7480cf
Update tests for hazard set up
Mares2022 f2378d3
Update docs/user_guide/user_guide_overview.rst
Santonia27 ee770e3
Update yaml example_guide_overview.rst
Santonia27 39c1cde
removed the unused imports and changed the names of the test
frederique-hub 44c3e5b
Delete tests/test_hazard.py
frederique-hub 311c091
update aggregation notebook and agg_config.yml
Santonia27 46d49c9
Merge branch '#64FlexibleAggregationArea' of https://github.com/Delta…
Santonia27 84ed31e
spelling mistake
Santonia27 a2796c4
Update aggregationzones.rst
Santonia27 ce40926
Improvement_aggregation_zones.rst
Santonia27 eeb21a2
create new test for building footprints
Santonia27 8772840
update aggregation test file path
Santonia27 e03c1d6
deleted output folder of test result
Santonia27 10dd8b6
create building footprint test
Santonia27 aacde2c
update fiat.py, create bf function, create bf test
Santonia27 ae862fb
update bf_test and function
Santonia27 634ec84
added vector lazer overlap function
Santonia27 c704cef
Sorted imports, made paths relative, moved files a bit
frederique-hub 807d0b1
Merge pull request #150 from Deltares/#64FlexibleAggregationArea
frederique-hub 216681c
Made the imports explicit, updated some documentation
frederique-hub 5500288
Moved set_tables to the bottom of the function
frederique-hub 9e19d78
update doc string. Add check to BF test for unique ID
Santonia27 6f99c73
add nearest neighbor in bf_exposure_join, function must be improved
Santonia27 c6b5026
cleaning building footprint code
Santonia27 2e75ca4
add relative path to bf_test
Santonia27 bce3b93
Merge pull request #168 from Deltares/PR#124-updates
frederique-hub fb2670e
Merge branch '#146-and-#125-gis-functions-in-separate-file-and-ground…
frederique-hub d5096de
Update LICENSE
frederique-hub ae093cf
Update README.rst
frederique-hub de2e12d
Update pyproject.toml
frederique-hub d9a9f41
corrected raising of buildings when using datum reference
panosatha 6cbe514
Added test for raising ground floor height relative to datum
frederique-hub 6fadf32
Merge pull request #172 from Deltares/correct_raise_datum
frederique-hub b6399cf
Merge pull request #174 from Deltares/env_fix
frederique-hub 0de2aa0
Modifications made after Frederique's review
Mares2022 da08b5a
update directory path
Santonia27 0d461cc
Making hazard functions explicits after Dirk review
Mares2022 3192d50
Change of .rio for .raster hyndromt core function
Mares2022 26a702a
Adding parameter geom when reading raster data
Mares2022 00cecae
Removing test using sfincs_map.nc
Mares2022 08700e5
Updated building footprints code and test, added assert statements
frederique-hub ce694f0
Merge branch '#133_Spatialbuildingfootprint' of https://github.com/De…
frederique-hub 536211b
Merge branch 'fiat_integrator' into #115-Check-and-update-hazard-model
frederique-hub 1befd34
Merge pull request #151 from Deltares/#115-Check-and-update-hazard-model
frederique-hub a66d031
Added to gitignore
frederique-hub e5cea56
Cleaned folder structure
frederique-hub d808ff7
Merge pull request #175 from Deltares/clean_aggregation_area_examples…
frederique-hub c189218
inner merge to not discard values
Santonia27 210696e
add check that original and new exposure have same length
Santonia27 d191a0e
Merge branch 'fiat_integrator' into #133_Spatialbuildingfootprint
frederique-hub 7447b65
Merge pull request #170 from Deltares/#133_Spatialbuildingfootprint
frederique-hub 1b5616a
split the get_table_and_metadata function into two functions
frederique-hub 226d479
Update the geoms and table properties of the FiatModel now only when …
frederique-hub 3dff621
Updated settings.toml configuration file output
frederique-hub dc09f25
Merge pull request #181 from Deltares/180-make-a-property-in-the-fiat…
frederique-hub File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I recommend to drop support for python 3.8 (core also doesn't support this any longer) and test with py 3.9-3.11.
Also it would be great to perform tests with the latest hydromt release as well as the latest main branch to quickly spot possible required updates in the plugin and/or the core. Brendan and/or Sam can help you with this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I actually deleted the tests.yml workflow file because until now we have been testing locally only, because we have been working with larger files. It would be nice however to set up a testing suite in Github Workflows. We have an issue for it: #25 and I included your suggestion there so we can consider it!