You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
save_object is slow for big models (~10K parameters)
Possible improvement 1
qs2 is a very fast format for saving and reading data. For huge models, fit$save_object() is slow in the rds format.
It would be great to ass the qs2 (or qs) option to save_object.
Possible improvement 2
allow save_object to save a set of parameters. Would this speed up the function?
Possible improvement 3
If we had the option of saving or reading draws as DuckDB, making the summary of one parameter would not require the loading of the whole posterior draws.
The text was updated successfully, but these errors were encountered:
Yeah, it's definitely slow for big models. We do have a section in the vignette (contributed by @wlandau) showing how to do it with qs::qsave(), but there's not a built-in option at the moment:
save_object
is slow for big models (~10K parameters)Possible improvement 1
qs2
is a very fast format for saving and reading data. For huge models,fit$save_object()
is slow in therds
format.It would be great to ass the
qs2
(orqs
) option tosave_object
.Possible improvement 2
allow
save_object
to save a set of parameters. Would this speed up the function?Possible improvement 3
If we had the option of saving or reading draws as DuckDB, making the summary of one parameter would not require the loading of the whole posterior draws.
The text was updated successfully, but these errors were encountered: