Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a benchmark report functionality #13

Closed
mchalela opened this issue Mar 9, 2021 · 0 comments
Closed

Add a benchmark report functionality #13

mchalela opened this issue Mar 9, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@mchalela
Copy link
Owner

mchalela commented Mar 9, 2021

Provide a function that computes time-benchmark stats for GriSPy methods. Something like the plots shown in the paper. This will allow us to easily compare the improvements introduced by new implementations. Time benchmark is the first priority, after that include a memory benchmark report.

API idea

The input should be the arrays of the parameter space over which the time stats should be computed.
For example:

import numpy as np
import grispy

# similar to Figure 4, second row.
Npoints = 10**np.arange(4, 8)
Ncells = 2**np.arange(3, 9)

# Compute the benchmark assuming a default configuration for the rest of the parameters
# Returns a custom pandas data frame with the stats
df = grispy.benchmark(Npoints=Npoints, Ncells=Ncells)  
df.plot(...)  # provide a custom plot method. This plot can be similar to those in the paper 
@mchalela mchalela added the enhancement New feature or request label Nov 2, 2021
@mchalela mchalela closed this as completed Nov 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant