-
Notifications
You must be signed in to change notification settings - Fork 37
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[WIP] Setup benchmark suite #332
base: main
Are you sure you want to change the base?
Conversation
d1969cc
to
a09002a
Compare
@@ -104,6 +104,11 @@ csp/lib/ | |||
*.so | |||
*.tsbuildinfo | |||
|
|||
# Benchmarks | |||
.asv | |||
ci/benchmarks/* |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
get some standardized machines before putting in raw data
I had missed the original discussion at #322 , that explains where a lot of this came from. Would be good to tidy up in any case. There are a whole bunch of benchmark tests that I want to write after... |
f5b9763
to
8790a83
Compare
Signed-off-by: Tim Paine <timothy.paine@cubistsystematic.com>
That benchmark script was just something I hacked together, I didn't intend for it to be a canonical example. |
I did a first pass approximation of a more general framework, extnded to the quantile function to demonstrate https://github.com/Point72/csp/blob/fb36b1b6f448d8c39aaab4edfb4b0ba7eed82ed7/csp/benchmarks/stats/basic.py |
@arhamchopra would be good to see if we can use our benchmark infrastructure to run csp benchmarks as well, and maybe fix some of the ugliness I introduced in this PR if we can. |
4075b07
to
65fa250
Compare
Signed-off-by: Tim Paine <3105306+timkpaine@users.noreply.github.com>
…ogic Signed-off-by: Arham Chopra <arham.chopra@cubistsystematic.com>
xref: #38
Following @trallard's suggestion, exploring using
asv
to build a benchmark suite, starting with @AdamGlustein's code in #322 (comment).Example output, running on just my machine through a few commits: