Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

exporting, subsetting, and matching output is quite slow #262

Open
jordansread opened this issue Jan 21, 2020 · 2 comments
Open

exporting, subsetting, and matching output is quite slow #262

jordansread opened this issue Jan 21, 2020 · 2 comments

Comments

@jordansread
Copy link
Member

We haven't taken a look at this code in a long time, but when doing multilake calibrations or different types of calibrations, the compare_to_field workflow is pretty slow. This is probably a low priority for the time being, but probably some easy wins using more modern packages to do this type of matching/interpolating within the output matrix.

Before starting on this it would be good to benchmark with an example.

@hdugan
Copy link
Collaborator

hdugan commented Feb 9, 2020

Yes, good idea. I think the time sink is in resample_to_field so I'll start there

@hdugan
Copy link
Collaborator

hdugan commented Feb 9, 2020

@jread-usgs rewrote resample_to_field using join function from dplyr. Improves speed about 25%. The rest of the time sink is in get_var

Also, I was trying to figure out how to update my branch with the new commits on the USGS ggoverhaul fork... and I'm not sure how, but managed to commit directly to it, instead of to mine 🤦‍♂. Since I've already messed up, going to leave it as is and not damage anything further.

Anyway, only changes are in resample_to_field

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants